Lead Databricks Data Engineer

Job Summary

A company is looking for a Lead Databricks Data Engineer.

Key Responsibilities

• Lead the design and implementation of standardized data management procedures
• Oversee the development and operation of large-scale data structures for business intelligence analytics
• Implement improvements for data reliability, efficiency, and quality while ensuring compliance with policies and standards

Required Qualifications

• Bachelor's degree in a quantitative or business field or equivalent experience
• 5 - 7 years of related experience in data engineering
• Advanced proficiency in Databricks Lakehouse Medallion architecture and Unity Catalog
• Experience with scalable data pipelines using PySpark, SQL, and/or Python on AWS Databricks
• Familiarity with cloud storage platforms such as S3 or Azure Blob