< More Jobs

Posted on 2026/04/03

AI Model Evaluation Expert for Domain-Specific Guidance

Mercor

Toronto, ON

Full-time

Job description

Become a pivotal AI Model Evaluation Contractor and harness your expertise to assess AI-generated outputs.

Evaluate factual accuracy and provide meaningful insights while working remotely on a flexible contract basis.

In this contract role, you will leverage your domain knowledge to evaluate AI responses for accuracy and applicability. Your professional experience in advisory capacities will guide... the development of realistic prompts.

Key responsibilities include scoring model responses, identifying inaccuracies, and documenting evaluations through structured rubrics.

Key Responsibilities:

• Write domain-specific prompts for AI evaluation

• Assess AI outputs for factual accuracy

• Identify misleading or fabricated claims

• Score model responses with structured assessments

• Provide evidence-based justifications for evaluations

Requirements:

• Professional expertise in a relevant domain

• Familiarity with industry regulations and standards

• Strong written communication skills required

• Critical reasoning skills for comprehensive analysis

• Experience in advisory or practitioner roles

Join a pioneering project that values domain expertise and critical evaluation skills in shaping AI performance.

#J-18808-Ljbffr

Show full description

Choose what you’re giving feedback on

Report this listing

Zero to AI Engineer Program

Zero to AI Engineer

Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.