Data DevOps Engineer

Job Summary

A company is looking for a Data DevOps Engineer with 8+ years of experience to join their ML/AI team.

Key Responsibilities

• Work on data pipeline for various ML/AI products
• Interface with DevOps teams to build out the pipelines
• Collaborate with Data Scientists and Software Engineers to implement new features
• Enhance monitoring and debuggability of existing pipelines

Required Qualifications

• Experience in setting up multitenant Spark & Kafka clusters
• Experience with infrastructure automation using Jenkins, Ansible, Terraform, or similar tools
• Strong skills in Python, Scala, or Java
• Experience in managing, analyzing, and processing large datasets
• Familiarity with database technologies, including NoSQL and SQL databases