Head of AI Evaluation Science

Job Summary

A company is looking for a Head of AI Evaluation Science.

Key Responsibilities

• Lead the AI Evaluation Science team, defining evaluation strategy for robot models
• Develop metrics and benchmarks for AI performance across various domains
• Design evaluation frameworks and maintain simulation environments for testing robot behaviors

Required Qualifications

• MS or PhD in Computer Science, Robotics, ML, EE, or related field
• 8+ years of experience in AI/ML, with proven leadership in technical teams
• Hands-on expertise in building and evaluating large multimodal ML models
• Strong background in defining metrics for AI/robotics systems
• Experience with simulation platforms for robotics or autonomous vehicles