Engineering Evaluations Specialist

Job Summary

A company is looking for a Member of Engineering (Evaluations).

Key Responsibilities

• Research and implement evaluations and benchmarks for models
• Collaborate with research and product teams to define metrics and evaluations
• Participate in team planning and communication of progress

Required Qualifications

• Experience with Large Language Models (LLM)
• Strong engineering background with programming skills in multiple languages
• Familiarity with the full software development life cycle
• Experience with Linux and strong algorithmic skills
• Curious mindset with a focus on continuous improvement