Job description Ai Response Evaluator - Generalist
• Contract and Payment Terms
• * You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
About the Opportunity
We are seeking highly skilled Generalists to support a fast-moving initiative with one of ...the world’s leading AI labs.
This project focuses on improving AI systems designed for therapeutic-style conversations by evaluating, comparing, and refining model-generated responses.
If you have strong analytical thinking, emotional intelligence, and excellent written communication skills, this role offers a unique opportunity to contribute to the development of safe, supportive, and human-aligned AI systems.
Role Overview
In this position, you will:
• Review and compare pairs of AI-generated responses
• Evaluate responses against structured criteria such as:
• Empathy
• Emotional insight
• Communication quality
• Appropriateness for supportive dialogue
• Provide clear reasoning for evaluations
• Rewrite responses to better align with therapeutic communication standards
• Support research teams in improving AI behavior in mental-health-oriented conversational settings
Your contributions will directly impact the refinement of AI systems designed for safe and supportive human interaction.
Minimum Qualifications
• Bachelor’s degree (required)
• Strong written English communication skills
• High emotional intelligence and sound judgment
• Ability to follow structured evaluation frameworks
• Comfort working with sensitive or emotionally nuanced content
• Ability to start immediately after onboarding
Preferred Qualifications
• Background in psychology, counseling, social sciences, humanities, or communications
• Experience in content evaluation, moderation, research, or QA
• Experience working with AI systems or language models Show full description Report this listing Loading...

Zero to AI Engineer
Skip the degree. Learn real-world AI skills used by AI researchers and engineers. Get certified in 8 weeks or less. No experience required.
Find AI, ML, Data Science Jobs By Location
Find Jobs By Position