< More Jobs

Posted on 2025/12/13

Staff ML Research Scientist — LLM Evaluations

Scale AI

San Francisco, CA, United States

Full-time

Qualifications

  • The ideal candidate has over 5 years of experience with LLMs and proven leadership skills in a fast-paced environment

Benefits

  • The position offers a competitive salary and comprehensive benefits

Responsibilities

  • You will lead the development of evaluation methodologies for large language models, define success metrics, and collaborate with industry leaders
  • Develop evaluation methodologies for large language models
  • Define success metrics for LLM evaluations
  • Collaborate with industry leaders on LLM research

Full Description

Job Description

A leading AI evaluation firm in San Francisco is seeking a Staff Machine Learning Research Scientist.

You will lead the development of evaluation methodologies for large language models, define success metrics, and collaborate with industry leaders.

Key Responsibilities:

• Develop evaluation methodologies for large language models.

• Define success metrics for LLM evaluations.

• Collaborate with industry leaders on LLM research.

The ideal candidate has over 5 years of experience with LLMs and proven leadership skills in a fast-paced environment.

The position offers a competitive salary and comprehensive benefits.