Remote AI Output Quality Assessor

Outlier is an innovative AI training platform managed by Scale AI. As an Outlier Expert, you will engage in a variety of projects, from crafting training data to evaluating AI model performance.

Exciting Opportunity Awaits!

We are looking for detail-oriented English speakers to review media generated by AI.

You will engage in realistic conversations with an AI voice model, evaluate image and video outputs, and provide written feedback about any discrepancies or issues you identify.

Enjoy the flexibility of working remotely and on your own schedule.

Your expertise will help shape the future of advanced AI systems. By participating in Outlier's evaluation process, you contribute to improving AI's performance in real-world applications.

Key Responsibilities

• Engage in scenario-based conversations in English with AI voice models, rating their naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos, evaluating which better meets the given prompt.
• Thoroughly inspect outputs for issues such as distorted anatomy, flickering or unnatural motion, and audio-visual synchronization problems.
• Rate outputs based on adherence, quality, and realism while providing detailed written explanations in English of your observations.

Common Tasks

• Image Evaluations: Compare two AI-generated images for the same prompt and determine which one better follows the instructions, considering quality and any visible artifacts.
• Video Evaluations: Assess AI-generated videos against specified prompts or evaluate edited videos compared to their original source.
• Video Caption Labeling: Label videos of people or robots performing tasks, breaking down each action and creating precise captions from AI-generated drafts.
• Audio and Voice Evaluations: Rate AI-generated speech based on naturalness, pronunciation, and resemblance to a target voice, sometimes requiring a brief voice recording for explanation.

Ideal Qualifications

• Fluent in English with strong written communication skills; comfortable with natural conversational speech.
• Detail-oriented with patience to carefully review outputs and identify subtleties.
• Adept at thinking on your feet and simulating realistic conversational scenarios.
• Experience crafting concise, evidence-based reviews and explanations.
• Ability to make decisive evaluations when confronted with flawed options.
• Preferred: Pursuing or possessing a Bachelor’s degree or higher.

Requirements to Sign Up

• Valid identification and mobile phone from your home country.
• An updated resume highlighting your qualifications.
• A LinkedIn profile indicating your education and work background.

Compensation

• Project Work: Earn up to $15 per hour.
• Additional Incentives: On average, contributors earn an extra 7.5% via Missions (Outlier's surge pricing). High-performing contributors may boost their earnings by an additional 11%.
• Payment Schedule: Payments processed weekly on Tuesdays for tasks from the prior week (Tuesday to Monday at midnight UTC), via PayPal, AirTM, or ACH transfer.
• Compensation may vary based on experience, skill assessments, location, project requirements, and other factors.

Higher rates may be offered for advanced qualifications, such as PhDs.

Rates for non-core work may be lower.

Why Join Outlier?

• Work flexibly with no minimum hours requirement; set your schedule from 5 to 40+ hours a week.
• Enjoy free access to top LLMs valued at over $200/month.
• Join a community of over 900K Outlier Experts across 52 countries, with over $600M paid to experts so far.
• Collaborate with professionals in your field to advance cutting-edge AI models.

How to Apply

• Create an account on Outlier.
• Upload your resume.
• Submit your valid identification.
• Start earning by completing tasks.

Currently Accepting Applicants From: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.

Please Note: This is a 1099 contract position within the Outlier.ai platform.

As a freelancer, you will not be classified as an employee and we do not offer internships, sponsorship, or employment.

You must be authorized to work in your country of residence.

International students may also be able to apply if they hold a valid visa.

Please consult your tax and immigration advisor for specific questions regarding your situation.