Lead Data Engineer

Job Summary

A company is looking for a Lead Azure Databricks Datalake Engineer.

Key Responsibilities

• Develop and optimize ETL/ELT pipelines using Databricks and Azure cloud technologies
• Perform data modeling and automation for data workflows
• Enhance performance tuning of data pipelines and manage data warehousing solutions

Required Qualifications

• 7-12 years of experience in a Data Engineering role
• Strong proficiency in PySpark, Python, and SQL
• Hands-on experience with Azure Data Factory, Azure DataBricks, and Azure Data Lake
• Experience with Delta Lake, Delta Live Tables, Autoloader, and Unity Catalog
• Strong background in data modeling and ETL processes