Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer ETL to manage and enhance their data infrastructure.

Key Responsibilities

• Design, implement, and optimize scalable ELT/ETL pipelines using Databricks, Spark, and Python
• Guide and mentor a team of data engineers while ensuring high-quality code through reviews
• Develop testing frameworks and validation rules to maintain data integrity and troubleshoot issues

Required Qualifications

• Bachelor's or master's degree in computer science, engineering, or a related field
• 7+ years of experience in data engineering, focusing on Databricks and Apache Spark
• Expert proficiency in Python and strong understanding of data structures and algorithms
• Deep expertise in SQL and experience with complex analytical queries
• Hands-on experience with the Databricks ecosystem, including Delta Lake and Data frame APIs