Senior Data Scientist

Job Summary

A company is looking for a Senior/Staff Data Scientist specializing in Product Experimentation & Evaluation (LLMs & AI).

Key Responsibilities

• Lead end-to-end experimentation, including hypothesis generation and analysis
• Build and maintain evaluation frameworks for LLMs, focusing on correctness and safety
• Develop predictive models and automate experiment pipelines to ensure data quality

Required Qualifications

• 8-12+ years of experience in data science or ML roles, with a focus on experiment design
• Proven track record in startup-style and large-scale product experimentation
• Experience leading teams and driving execution in cross-functional environments
• Strong background in statistical methods and causal inference
• Proficient in Python and SQL, with experience in building and deploying models