Remote AI Media Evaluator. Job in Corpus Christi TopStateCareers

Outlier, an innovative AI training platform managed by Scale AI, invites you to become an Outlier Expert. In this role, you will engage in a variety of exciting projects, including generating training data and evaluating AI model performance.

About the opportunity

We are on the lookout for detail-oriented English speakers to assess AI-generated media.

Your responsibilities will include roleplaying live conversations with an AI voice model, scoring each interaction, comparing images and videos to identify which aligns better with provided prompts, and articulating your feedback in writing—all from the comfort of your home and according to your schedule.

Your expertise will play a crucial role in shaping how advanced AI systems reason, learn, and evolve. By participating in this evaluation and feedback loop, your contributions will facilitate the application of cutting-edge research into real-world AI solutions.

Responsibilities

• Engage in live, scenario-based conversations in English with AI voice models, evaluating their naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, determining which adheres to the prompt more effectively.
• Conduct thorough inspections of outputs, including zooming in and replaying to identify issues such as distorted anatomy, unnatural motion, text inaccuracies, and mismatched audio.
• Rate each output on aspects like adherence, quality, and realism, providing detailed, written explanations of your observations.

Common tasks

• Image evaluations: Analyze pairs of AI-generated images for the same prompt and select the superior option based on adherence to guidelines, visual quality, and any visible AI artifacts.
• Video evaluations: Assess AI-generated videos against text prompts or edited versions against their source material.
• Video caption labeling: Label first-person videos featuring individuals or robots performing tasks by dissecting each clip into distinct actions and crafting accurate captions, starting from an AI draft and refining as necessary.
• Audio and voice evaluations: Evaluate AI-generated speech based on naturalness, pronunciation, and alignment with a target voice, which may involve recording short voice explanations of your choices.

Ideal qualifications

• Fluent English speaker with excellent written communication skills and comfort in natural conversational speech.
• A keen eye for detail, with the dedication to closely observe and listen, as well as the willingness to replay or zoom in when needed.
• Quick-thinking ability, capable of navigating realistic situations conversationally.
• Experience crafting concise, evidence-based explanations or reviews.
• Ability to make clear decisions even when both options have drawbacks.
• Preferred: Pursuing or holding a Bachelor’s degree or higher.

What you'll need to sign up

• A valid ID and mobile phone from your country of residence.
• An updated resume that showcases your relevant expertise.
• A LinkedIn profile reflecting your educational background and work experience.

Payment

• Project work: Earn up to USD $15 per hour.
• Additional incentives: Contributors on average earn an additional 7.5% through Missions, with top earners boosting their income by an additional 11%.
• Payment schedule: Payments are processed weekly on Tuesdays, covering tasks completed the previous week, via PayPal, AirTM, or ACH transfer.
• Rates may vary based on experience, skills assessment, location, project needs, and other factors, including potentially higher rates for advanced degrees.

Why join Outlier

• Enjoy flexibility by working from anywhere, setting your own hours with no minimum requirements.
• Gain free access to leading LLMs, valued at over $200/month.
• Become part of a community of over 900,000 Outlier Experts across 52 countries, with over $600 million distributed to experts.
• Collaborate with professionals in your field to further advance pre-release models.

How to apply

• Create an account on Outlier.
• Upload your resume.
• Upload your valid ID.
• Start earning by completing tasks.

Currently accepting applicants from: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States.

Please note: This is a contract opportunity through the Outlier platform.

You will be an independent contractor and not an employee.

As this is a freelance opportunity, we do not offer internships, sponsorships, or employment.

You must be authorized to work in your country of residence.

If you are an international student, you may apply if on a visa; consult your tax and/or immigration advisor for specifics regarding your circumstances.