AI Training Data Evaluator - English - Remote. Job in Fort Worth TopStateCareers

Outlier is an innovative AI training platform powered by Scale AI. As an Outlier Expert, you'll engage in diverse projects that involve generating training data and assessing model performance.

About the opportunity

We are on the lookout for meticulous English speakers to review AI-generated content.

This role involves conducting live conversations with an AI voice model and assessing each interaction, comparing AI-generated images and videos to determine which is more aligned with the prompt, and providing detailed written explanations of any discrepancies—all from the comfort of your own home and on your schedule.

Your expertise plays a crucial role in refining how advanced AI systems reason, learn, and evolve. Participation in Outlier's feedback loop ensures that cutting-edge research translates into AI capable of performing effectively in real-world applications.

Responsibilities

• Engage in live, scenario-based conversations in English with AI voice models, then evaluate the naturalness, usefulness, and clarity of each exchange.
• Analyze pairs of AI-generated images and videos to determine which one better adheres to the prompt.
• Scrutinize outputs closely, using zoom and replay functions to identify issues like distorted anatomy, unnatural motion, text errors, and audio mismatches.
• Assign ratings to each output based on parameters like adherence, quality, and realism, while composing specific explanations in English about your observations.

Common tasks

• Image evaluations: Compare two AI-generated images for the same text prompt and select the superior one, evaluating adherence to instructions and visual quality.
• Video evaluations: Assess AI-generated videos against a text prompt or edit comparisons with their source clips.
• Video caption labeling: Document actions in first-person videos featuring individuals or robots performing tasks, breaking down clips into individual actions and refining provided captions.
• Audio and voice evaluations: Evaluate AI-generated speech for naturalness and pronunciation, and assess alignment with target voices, sometimes requiring recorded voice explanations of your ratings.

Ideal qualifications

• Fluent English speaker with exceptional written communication skills, and comfort with informal conversational speech.
• Strong attention to detail, patience in closely examining outputs, and willingness to review content as necessary.
• Ability to think rapidly and converse naturally in various simulated scenarios.
• Experience composing concise, evidence-based assessments or reviews.
• Capable of making clear decisions even when both options have shortcomings.
• Preferred: Currently pursuing or holding a Bachelor's degree or higher.

What you'll need to sign up

• A valid ID and a mobile phone from your country of residence.
• An updated resume that emphasizes your strengths.
• A LinkedIn profile showcasing your educational background and work history.

Payment

• Project work: Earn up to USD $15 per hour.
• Additional incentives: Contributors typically earn an additional 7.5% through Missions, Outlier's surge pricing model. Top performers can enhance their earnings by an average of 11%.
• Payment schedule: Payments are processed weekly on Tuesdays, covering work completed in the previous pay period (Tuesday to Monday at midnight UTC), via PayPal, AirTM, or ACH transfer.
• Note: Rates may vary based on expertise, skills assessment, location, and project needs, with potential for higher rates for PhD holders. Initial project onboarding may have lower rates.

Why join Outlier

• Enjoy the flexibility of working from anywhere, at any time, with no minimum hour requirements. Set your schedule, whether it's five hours or 40+ per week.
• A complimentary subscription to leading LLMs valued at over $200 per month.
• Join a community of 900K+ Outlier Experts across 52 countries, with over $600M paid to contributors.
• Collaborate with field experts to advance cutting-edge pre-release models.

How to apply

• Create an account on Outlier.
• Upload your resume.
• Upload your valid ID.
• Start earning by completing tasks.

Currently accepting applicants from: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.

Please note: This opportunity operates as a 1099 contract on the Outlier.ai platform.

You will be joining Outlier as a freelancer/independent contractor, not an employee.

As a freelance role, we do not provide internships, sponsorship, or employment.

Eligibility to work in your country of residence is required.

International students may qualify if they are on an appropriate visa. Consult your tax or immigration advisor for questions specific to your situation.