Senior DataOps Engineer

Job Summary

A company is looking for a Senior DataOps Engineer to shape their data platform and optimize data infrastructure.

Key Responsibilities

• Build, scale, and optimize the data platform using Databricks, Spark, and various data integration tools
• Design and maintain robust data pipelines and automate infrastructure to enhance operational readiness and security
• Develop and maintain infrastructure for MLOps practices, including model deployment pipelines and monitoring frameworks

Required Qualifications

• 4+ years of hands-on experience in Data Engineering with a focus on data platforms and cloud technologies
• Expertise in designing and building distributed systems and data pipelines using tools like Astronomer, Fivetran, and DBT
• Proficiency in Python, Scala, SQL, and Spark for developing scalable data pipelines
• Solid understanding of cloud infrastructure (AWS/Azure) and experience with Terraform for automating cloud resource management
• Experience with data governance, security practices, and compliance to maintain data integrity and privacy