Posted on 2026/04/03
AI Model Evaluation Expert for Domain-Specific Guidance
Mercor
Toronto, ON
Job description
Become a pivotal AI Model Evaluation Contractor and harness your expertise to assess AI-generated outputs.
Evaluate factual accuracy and provide meaningful insights while working remotely on a flexible contract basis.
In this contract role, you will leverage your domain knowledge to evaluate AI responses for accuracy and applicability. Your professional experience in advisory capacities will guide... the development of realistic prompts.
Key responsibilities include scoring model responses, identifying inaccuracies, and documenting evaluations through structured rubrics.
Key Responsibilities:
• Write domain-specific prompts for AI evaluation
• Assess AI outputs for factual accuracy
• Identify misleading or fabricated claims
• Score model responses with structured assessments
• Provide evidence-based justifications for evaluations
Requirements:
• Professional expertise in a relevant domain
• Familiarity with industry regulations and standards
• Strong written communication skills required
• Critical reasoning skills for comprehensive analysis
• Experience in advisory or practitioner roles
Join a pioneering project that values domain expertise and critical evaluation skills in shaping AI performance.
#J-18808-Ljbffr
Show full description
Choose what you’re giving feedback on
Report this listing

Zero to AI Engineer
Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.
Find AI, ML, Data Science Jobs By Location
Find Jobs By Position