AI Trainer Quality Assurance

Job Summary

A company is looking for an Autonomous AI Agents - Quality Assurance (AI Trainer).

Key Responsibilities

• Review evaluation tasks and scenarios for logic, completeness, and realism
• Identify inconsistencies, missing assumptions, or unclear decision points
• Help define clear expected behaviors (gold standards) for AI agents

Required Qualifications

• Excellent analytical thinking skills for reasoning about complex systems
• Familiarity with structured data formats, such as JSON/YAML
• Experience with policy evaluation, logic puzzles, or structured scenario design
• Background in consulting, academia, or research
• Some understanding of scoring or evaluation in agent testing