AI Platform Engineer - Search/LLMs/Q&A

Qualifications

• Bachelor’s degree in Computer Science or a related field (or 15+ years equivalent experience)
• Advanced programming skills in Java and Python, especially for building back-end services, APIs, and workflow automation
• Direct experience with search technology stacks and Retrieval-Augmented Generation (RAG), including vector embeddings and prompt engineering
• Mastery in diagnosing and resolving cross-stack issues—ability to pinpoint root causes in data flows, retrieval methods, prompt logic, and back-end code
• Hands-on experimentation skills: A/B testing, metric definition, analysis, and application of findings to production AI systems
• Familiarity with AI observability, drift detection, and monitoring using leading industry tools
• Proven track record coordinating multi-team engineering efforts, driving solutions in partnership with product operations, and communicating clearly across stakeholders
• Experience with CI/CD processes, version control, automated testing frameworks, and feature flag management
• Results-oriented mindset with the ability to rapidly manage shifting priorities and see solutions through from detection to closure

Benefits

• This exciting opportunity launches as a 10-month W2 contract offering competitive benefits, a hybrid work schedule, and strong potential for extension or conversion
• Medical Insurance - Four medical plans to choose from for you and your family
• Dental & Orthodontia Benefits
• Vision Benefits
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
• Hospital Indemnity Insurance
• Paid Sick Time Leave
• Legal and Identity Protection Plans
• Pre-tax Commuter Benefit
• 529 College Saver Plan

Responsibilities

• In this impactful role, you’ll act as the critical bridge between product operations and engineering, creating world-class AI evaluation tools, automating content analysis, and ensuring guests and team members receive outstanding, reliable answers from their new AI-powered Q/A search tool, which you will help develop
• If you want to build solutions that enable state-of-the-art search, prompt tuning, and continuous quality improvements in a hyper-dynamic environment, this is your chance to make an immediate difference
• Partner with product teams to design and run experiments that enhance models, prompts, content aggregation, retrieval logic, and automated protections, tracking key metrics with advanced observability platforms
• Build and refine tools for detecting content gaps, diagnosing retrieval issues, and evaluating and tuning prompts, ensuring the platform delivers consistently high-quality answers
• Define, track, and report on critical performance indicators like answer precision/recall, relevance, accuracy, and latency, maintaining robust dashboards for ongoing monitoring
• Investigate and resolve search platform and answer quality issues, collaborating across engineering, content, and operations to tackle bugs, configuration challenges, and gaps
• Lead root cause analysis for incidents, implement or coordinate fixes across teams, and institute systematic improvements to boost relevance, quality, and reliability
• Own triage and hypercare after new releases: coordinate issue logging, prioritization, resolution, and clear communications with service levels in mind
• Document solutions, create runbooks and playbooks, and establish repeatable processes for rapid troubleshooting, experimentation, and operational excellence

Full Description

One of the country’s largest entertainment and technology providers is searching for a skilled AI Platform Engineer to join their AI enablement team on a hybrid basis in Glendale, CA.

In this impactful role, you’ll act as the critical bridge between product operations and engineering, creating world-class AI evaluation tools, automating content analysis, and ensuring guests and team members receive outstanding, reliable answers from their new AI-powered Q/A search tool, which you will help develop.

If you want to build solutions that enable state-of-the-art search, prompt tuning, and continuous quality improvements in a hyper-dynamic environment, this is your chance to make an immediate difference.

This exciting opportunity launches as a 10-month W2 contract offering competitive benefits, a hybrid work schedule, and strong potential for extension or conversion.

Please Note: This position cannot support C2C or offer sponsorship/transfer of any visas.

Responsibilities:

• Partner with product teams to design and run experiments that enhance models, prompts, content aggregation, retrieval logic, and automated protections, tracking key metrics with advanced observability platforms.

• Build and refine tools for detecting content gaps, diagnosing retrieval issues, and evaluating and tuning prompts, ensuring the platform delivers consistently high-quality answers.

• Define, track, and report on critical performance indicators like answer precision/recall, relevance, accuracy, and latency, maintaining robust dashboards for ongoing monitoring.

• Investigate and resolve search platform and answer quality issues, collaborating across engineering, content, and operations to tackle bugs, configuration challenges, and gaps.

• Lead root cause analysis for incidents, implement or coordinate fixes across teams, and institute systematic improvements to boost relevance, quality, and reliability.

• Own triage and hypercare after new releases: coordinate issue logging, prioritization, resolution, and clear communications with service levels in mind.

• Document solutions, create runbooks and playbooks, and establish repeatable processes for rapid troubleshooting, experimentation, and operational excellence.

Skills & Experience:

• Bachelor’s degree in Computer Science or a related field (or 15+ years equivalent experience)

• Advanced programming skills in Java and Python, especially for building back-end services, APIs, and workflow automation

• Direct experience with search technology stacks and Retrieval-Augmented Generation (RAG), including vector embeddings and prompt engineering

• Mastery in diagnosing and resolving cross-stack issues—ability to pinpoint root causes in data flows, retrieval methods, prompt logic, and back-end code

• Hands-on experimentation skills: A/B testing, metric definition, analysis, and application of findings to production AI systems

• Familiarity with AI observability, drift detection, and monitoring using leading industry tools

• Proven track record coordinating multi-team engineering efforts, driving solutions in partnership with product operations, and communicating clearly across stakeholders

• Experience with CI/CD processes, version control, automated testing frameworks, and feature flag management

• Results-oriented mindset with the ability to rapidly manage shifting priorities and see solutions through from detection to closure

Preferred Experience:

• Exposure to agentic AI design (complex workflow orchestration, automated actions)

• Hands-on work with Google Cloud (especially Vertex AI), Elasticsearch/OpenSearch/Lucene, vector databases, reranking, and embedding models

• Familiarity with tools like AppDynamics, Splunk, Grafana, and Arize for observability and analytics

• Understanding of Responsible AI practices, content governance, and rigorous guardrail implementation

You will receive the following benefits:

• Medical Insurance - Four medical plans to choose from for you and your family

• Dental & Orthodontia Benefits

• Vision Benefits

• Health Savings Account (HSA)

• Health and Dependent Care Flexible Spending Accounts

• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance

• Hospital Indemnity Insurance

• Paid Sick Time Leave

• Legal and Identity Protection Plans

• Pre-tax Commuter Benefit

• 529 College Saver Plan

Motion Recruitment Partners is an Equal Opportunity Employer, including disability/vets.

All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available.

Employment is subject to the successful completion of a pre-employment screening.

Accommodation will be provided in all parts of the hiring process as required under Motion Recruitment Employment Accommodation policy. Applicants need to make their needs known in advance.