Senior Databricks Data Engineer

Job Summary

A company is looking for a Senior Databricks Data Engineer.

Key Responsibilities

• Develop and operationalize data pipelines for data consumption, including ingestion, transformation, and quality assurance
• Guide the design and implementation of complex data management procedures and provide guidance to data engineers
• Design, develop, and maintain real-time processing applications and data pipelines while ensuring solution quality

Required Qualifications

• Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science)
• 4 - 6 years of related experience or equivalent experience
• Experience with Databricks Lakehouse Medallion architecture and Unity Catalog
• Skilled in building complex data pipelines using PySpark, SQL, and/or Python on Databricks or comparable cloud DBMS
• Proficient in handling various data formats on cloud platforms (AWS, Azure, GCP)