Job Summary
A company is looking for a Lead Databricks Engineer to drive the design, development, and optimization of data pipelines and analytics solutions on the Databricks Lakehouse platform.
Key Responsibilities
- Lead end-to-end development of data pipelines, ETL/ELT processes, and batch/streaming solutions using Databricks and Apache Spark
- Design and implement Lakehouse architectures that align with business and technical requirements
- Collaborate with data scientists, analysts, and engineers to deliver high-performance data products and ML features
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field
- 5+ years of experience in Data Engineering or Big Data roles
- 2+ years of hands-on experience with Databricks, Spark (PySpark or Scala), and Delta Lake
- Strong knowledge of cloud platforms (AWS, Azure, or GCP) and modern data architectures
- Experience leading a team or a project, acting as a team/tech lead of a project
Comments