Remote AI Evaluation Specialist - Flexible Hours

Outlier, an AI training platform owned by Scale AI, is looking for detail-oriented English speakers to join our team of Outlier Experts. In this role, you will contribute to a variety of exciting projects, including generating training data and evaluating AI model performance.

About the opportunity

As an AI Evaluation Specialist, you will review AI-generated media, hold live conversations with AI voice models, compare generated images and videos, and provide written evaluations of your findings—all from the comfort of your own home and according to your schedule.

Your expertise will play a crucial role in enhancing AI systems, making them more effective for real-world applications.

Your feedback will contribute significantly to the advancement of cutting-edge AI technology.

Responsibilities

• Conducting live conversations with AI voice models and evaluating their performance based on naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos to determine which one more effectively follows a given prompt.
• Carefully inspecting outputs to identify issues such as distorted imagery, unnatural movements, or incorrect audio.
• Rating outputs on factors like adherence to prompts, overall quality, and realism, and writing detailed explanations of your assessments in clear English.

Common tasks

• Image evaluations: Compare AI-generated images based on the same prompt, assessing adherence to instructions and overall visual quality.
• Video evaluations: Rate AI-generated videos against text prompts, noting any discrepancies or improvements needed.
• Video caption labeling: Annotate first-person videos by splitting them into individual actions and correcting captions as necessary.
• Audio and voice evaluations: Assess AI-generated speech for naturalness and accuracy, with some tasks requiring you to record a brief explanation of your evaluation.

Ideal qualifications

• Fluent in English with strong written communication skills and familiarity with conversational speech.
• Meticulous attention to detail, demonstrating patience when reviewing outputs closely.
• Ability to think quickly and engage in realistic dialogues with AI.
• Experience crafting concise, evidence-based evaluations or reviews.
• Capability to make clear decisions when presented with flawed options.
• Preferred: Currently pursuing or holding a Bachelor’s degree or higher.

What you'll need to sign up

• A valid ID and mobile phone from your country of residence.
• An updated resume that showcases your relevant skills.
• A LinkedIn profile reflecting your educational background and work experience.

Payment

• Project work: Earn up to USD $15 per hour.
• Additional incentives: On average, contributors can earn an extra 7.5% through additional tasks, with top performers boosting their earnings by an average of 11%.
• Payment schedule: Payments are processed weekly on Tuesdays for tasks completed in the prior pay period.
• Note that rates vary based on expertise and skill assessments.

Why join Outlier

• Enjoy flexible work from anywhere, allowing you to choose your hours with no minimum time commitments.
• Gain free access to leading LLMs, valued at over $200/month.
• Join a vast community of over 900K Outlier Experts in 52 countries, collectively earning over $600M.
• Collaborate with professionals in your field to advance the capabilities of cutting-edge AI models.

How to apply

• Create an account on Outlier.
• Upload your resume.
• Upload your valid ID.
• Start completing tasks to begin earning!

Currently accepting applicants from: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.

Please note: This is a 1099 contract opportunity on the Outlier.ai platform.

You will be joining as a freelancer/independent contractor, not as an employee.

You must be authorized to work in your country of residence. For international students, you may be able to sign up if you are on a visa; please consult your tax and/or immigration advisor for specific inquiries.