Posted on 2026/07/15
Sr. Applied Scientist, Alexa AI
Amazon
Seattle, WA, United States
Qualifications
-
A successful candidate will have a strong machine learning background, a deep understanding of the conversational AI stack, and a desire to push the envelope in conversational-AI evaluation
-
The ideal candidate has hands-on experience building Generative AI solutions with LLMs, including LLM-as-a-Judge (LLMaaJ), model distillation, Supervised Fine-Tuning (SFT), In-Context Learning (ICL), and Learning from Human Feedback (LHF)
-
PhD, or Master's degree and 5+ years of applied research experience
Benefits
-
Your Amazon package will include sign-on payments and restricted stock units (RSUs)
-
Final compensation will be determined based on factors including experience, qualifications, and location
-
Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave
Responsibilities
-
As a senior member of the team, you will own ambiguous, high-impact evaluation problems end-to-end — from defining the scientific direction to shipping the models and metrics that millions of customers and the developers who build for them depend on
-
As an Applied Scientist, you will leverage your technical expertise to set the research agenda for how we measure conversational quality, mentor other scientists and engineers, and partner across science, engineering, and business teams to research and develop novel evaluation methods
-
You will analyze and understand customer experiences using Amazon's heterogeneous data sources, and design, train, and maintain the evaluation models that serve as the source of truth for assistant quality
Description
As part of the Alexa AI team, our mission is to provide scalable and reliable evaluation of state-of-the-art Conversational AI. We are looking for a passionate, talented, and resourceful Applied Scientist in the field of Large Language Models (LLMs), Artificial Intelligence (AI), and Natural Language Processing (NLP) to invent and build the end-to-end evaluation of how customers perce
Find AI, ML, Data Science Jobs By Location
Find Jobs By Position