Content Quality Evaluator

Qualifications

• Education: Bachelor’s degree or higher (or currently enrolled)
• Analytical Skills: Proficient in crafting complex prompts and assessing sophisticated AI reasoning
• Strong Writing Abilities: Clear, concise, and engaging writing style for explaining decisions and critiquing responses
• Attention to Detail: Commitment to precision and ability to evaluate the technical aspects of model outputs

Benefits

• Enjoy a competitive pay rate of up to $15 USD/hr, along with performance-based rewards
• Earn up to $15 USD/hr, with weekly payouts
• Pay rates may vary based on the quality of work, accuracy, and time invested
• Payments are processed via PayPal and AirTM
• Interact with top-tier large language models at no cost
• You set your hours (most contributors work 5-10 hours/week, with possible maximum of 40 hours from home)
• Note: Pay rates are subject to adjustment for non-primary tasks such as initial onboarding or project overtime

Responsibilities

• Adopt a 'user perspective' to generate realistic data that meets actual user needs when utilizing AI
• Apply the rubrics tool to systematically address user requirements
• Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models
• Participate in various projects based on your unique skill set and experience

Full Description

Become part of a dynamic team of professionals dedicated to advancing AI technology.

Enjoy a competitive pay rate of up to $15 USD/hr, along with performance-based rewards.

At Outlier, which is proudly owned and operated by Scale AI, we aim to enhance the intelligence and safety of AI models.

Our collaboration with experts and top AI labs has been recognized in publications like Forbes, highlighting our commitment to high-quality data for large language models.

We believe that AI's effectiveness is directly linked to the quality of the data used to train it.

That's why we engage contributors worldwide to enhance AI through expert human feedback.

Your contributions will play a vital role in the advancements of leading AI labs and LLM developers.

We offer a state-of-the-art remote working platform designed for our freelance contributors, ensuring they can showcase their specialized skills in a supportive environment built on reliability, transparency, and flexibility.

Key Responsibilities:

• Adopt a 'user perspective' to generate realistic data that meets actual user needs when utilizing AI.

• Apply the rubrics tool to systematically address user requirements.

• Evaluate AI outputs by reviewing and ranking reasoning and problem-solving responses from large language models.

• Participate in various projects based on your unique skill set and experience.

Ideal Candidate Profile:

• Education: Bachelor’s degree or higher (or currently enrolled).

• Analytical Skills: Proficient in crafting complex prompts and assessing sophisticated AI reasoning.

• Strong Writing Abilities: Clear, concise, and engaging writing style for explaining decisions and critiquing responses.

• Attention to Detail: Commitment to precision and ability to evaluate the technical aspects of model outputs.

Preferred Qualifications:

• Background in fields such as literature, creative writing, history, philosophy, or theology.

• Previous experience in writing or editorial roles (content strategist, technical writer, editor, etc.).

• An interest or background in AI, machine learning, or creative technology tools.

Compensation and Benefits:

Earn up to $15 USD/hr, with weekly payouts.

Pay rates may vary based on the quality of work, accuracy, and time invested.

Payments are processed via PayPal and AirTM.

Access to Model Playground:

Interact with top-tier large language models at no cost.

Flexible Scheduling:

No strict contracts or 9-to-5 demands.

You set your hours (most contributors work 5-10 hours/week, with possible maximum of 40 hours from home).

Join a Community of Experts:

Become part of a global network of professionals contributing to advanced AI solutions.

Note: Pay rates are subject to adjustment for non-primary tasks such as initial onboarding or project overtime.

Incentives may be available for certain projects, so please review project-specific payment terms.

Equal Opportunity Employer: Outlier is devoted to fostering an inclusive and diverse workplace.

We celebrate applicants from all backgrounds and embrace diversity in our team.