Job Summary
A company is looking for a Senior Data Scientist - ML Operations & Analytics.
Key Responsibilities
- Build ML operations analytics tracking pipeline health, costs, latency, and quality metrics across all services
- Lead LLM evaluation initiatives using frameworks like Braintrust or Langfuse, designing custom metrics and quality monitoring
- Create actionable dashboards and insights for ML teams and leadership
Qualifications
- 3+ years in data science, ML operations, or analytics engineering
- Experience with LLM evaluation frameworks and quality metrics design
- Strong Python, SQL, and data visualization skills
- Knowledge of prompt optimization techniques
- Ability to meet periodically in the Prague office for collaboration
Comments