Engineering Member (Fine-tuning)

Job Summary

A company is looking for a Member of Engineering (Fine-tuning).

Key Responsibilities

• Research and experiment on ways to specialize foundational models to coding use cases
• Build and maintain data and training pipelines
• Design, analyze, and iterate on training/fine-tuning/data generation experiments

Required Qualifications

• Experience with Large Language Models (LLM) and deep knowledge of Transformers
• Strong deep learning fundamentals and fine-tuning experience with LLMs
• Programming experience in Python with PyTorch or Jax
• Research experience in proposing and evaluating novel research ideas
• Familiarity with state-of-the-art topics such as synthetic data generation and code generation