AI Trainer technical writing/content creation/curriculum design/AI reviewer

Full Description

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.

With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview As an AI Trainer, you will play a crucial role in the development and enhancement of AI systems.

You will analyze sample questions and guidelines to identify core skills being tested, create new, high-complexity questions and corresponding ground-truth answers.

You will develop detailed evaluation checklists and generate LLM outputs (e.

g., ChatGPT 5, Claude Sonnet 4.

5. for comparison.

The position requires 30-40h/week commitment and 4 or more hours overlap with PST.

The project will last 4 weeks.

Start date is ASAP.

This role is central to advancing AI agent capabilities beyond current performance benchmarks.

Analyze example questions and guidelines to determine the core skill being tested (e.

g., complex reasoning, multi-source synthesis, nuance detection).

Create entirely new questions on the same topic and with similar complexity to the example, ensuring the new challenge requires deep resourcefulness and avoids simple recall or pattern matching.

Develop accurate, and comprehensive "Ground Truth" answer** for the newly created question.

This answer must serve as the gold standard for AI performance.

Design a detailed Checklist to evaluate the quality of an answer.

This checklist must be precise, quantifiable, and outline all necessary components for a "successful" response, including criteria for accuracy, completeness, logical flow, and resource citation/synthesis.

Obtain and document the responses to the newly created question from leading large language models (e.

g., **ChatGPT 5 and Claude Sonnet 4.

5**). 2+ years of proven experience in technical writing, content creation, curriculum design, or AI data labeling/review.

Exceptional analytical and critical thinking skills with the ability to deconstruct complex problems into core logical components.

Mastery of synthesis: demonstrated ability to accurately and concisely combine information from multiple, potentially conflicting, sources.

Meticulous attention to detail - for generating both high-quality questions and error-free, comprehensive Ground Truth answers.

Deep understanding of Large Language Models (LLMs) and the common failure modes (e.

g., hallucination, superficial answers, lack of depth).

Ability to strictly adhere to complex guidelines and quality control standards.