Job Summary
A company is looking for a Lead Data Engineer Databricks.
Key Responsibilities:
- Collaborate in defining the overall architecture of data solutions, including modern Enterprise Data Warehouse and Data Lakehouse architectures
- Design, develop, test, and deploy processing modules using SQL, Stored Procedures, and Pyspark
- Build and optimize data pipelines on platforms like Databricks, SQL Server, or Azure Data Fabric
Required Qualifications:
- Current knowledge of modern data tools such as Databricks, FiveTran, and Data Fabric
- Experience with data architecture, data integrations, data warehousing, and ETL/ELT processes
- Applied experience in SQL, Stored Procedures, and Pyspark
- Strong knowledge of cloud and hybrid relational database systems like MS SQL Server, PostgresSQL, and Oracle
- Experience with batch and streaming data processing techniques
Comments