Apply on Employer Site

Motion Recruitment · 1 week ago

AI Platform Engineer - Search/LLMs/Q&A

Seattle, WA

Contract

Hybrid

Mid, Senior Level, Lead/Staff

$82/hr - $88/hr

15+ years exp

Motion Recruitment is one of the country’s largest entertainment and technology providers, seeking a skilled AI Platform Engineer to join their AI enablement team. In this role, you will act as a critical bridge between product operations and engineering, creating AI evaluation tools and ensuring high-quality answers from an AI-powered Q/A search tool.

Information TechnologyRecruitingStaffing Agency

No H1B

Responsibilities

Partner with product teams to design and run experiments that enhance models, prompts, content aggregation, retrieval logic, and automated protections, tracking key metrics with advanced observability platforms

Build and refine tools for detecting content gaps, diagnosing retrieval issues, and evaluating and tuning prompts, ensuring the platform delivers consistently high-quality answers

Define, track, and report on critical performance indicators like answer precision/recall, relevance, accuracy, and latency, maintaining robust dashboards for ongoing monitoring

Investigate and resolve search platform and answer quality issues, collaborating across engineering, content, and operations to tackle bugs, configuration challenges, and gaps

Lead root cause analysis for incidents, implement or coordinate fixes across teams, and institute systematic improvements to boost relevance, quality, and reliability

Own triage and hypercare after new releases: coordinate issue logging, prioritization, resolution, and clear communications with service levels in mind

Document solutions, create runbooks and playbooks, and establish repeatable processes for rapid troubleshooting, experimentation, and operational excellence

Qualification

JavaPythonSearch technology stacksRetrieval-Augmented GenerationA/B testingAI observabilityCI/CD processesGoogle CloudCommunication skillsResults-oriented mindset

Required

Bachelor's degree in Computer Science or a related field (or 15+ years equivalent experience)

Advanced programming skills in Java and Python, especially for building back-end services, APIs, and workflow automation

Direct experience with search technology stacks and Retrieval-Augmented Generation (RAG), including vector embeddings and prompt engineering

Mastery in diagnosing and resolving cross-stack issues—ability to pinpoint root causes in data flows, retrieval methods, prompt logic, and back-end code

Hands-on experimentation skills: A/B testing, metric definition, analysis, and application of findings to production AI systems

Familiarity with AI observability, drift detection, and monitoring using leading industry tools

Proven track record coordinating multi-team engineering efforts, driving solutions in partnership with product operations, and communicating clearly across stakeholders

Experience with CI/CD processes, version control, automated testing frameworks, and feature flag management

Results-oriented mindset with the ability to rapidly manage shifting priorities and see solutions through from detection to closure

Preferred

Exposure to agentic AI design (complex workflow orchestration, automated actions)

Hands-on work with Google Cloud (especially Vertex AI), Elasticsearch/OpenSearch/Lucene, vector databases, reranking, and embedding models

Familiarity with tools like AppDynamics, Splunk, Grafana, and Arize for observability and analytics

Understanding of Responsible AI practices, content governance, and rigorous guardrail implementation

Benefits

Medical Insurance - Four medical plans to choose from for you and your family

Dental & Orthodontia Benefits

Vision Benefits

Health Savings Account (HSA)

Health and Dependent Care Flexible Spending Accounts

Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance

Hospital Indemnity Insurance

Paid Sick Time Leave

Legal and Identity Protection Plans

Pre-tax Commuter Benefit

529 College Saver Plan

Company

Motion Recruitment

Glassdoor3.5

Motion Recruitment, a Kelly® Company, delivers IT Talent Solutions for Contract, Direct Hire, Managed Solutions and Statement of Work to all of North America from our 21 delivery centers.

Founded in 1989

Boston, Massachusetts, USA

501-1000 employees