Job Summary
A company is looking for a Data Engineer to join the Lat61 team.
Key Responsibilities
- Build and optimize data ingestion pipelines on Databricks for various data types
- Implement scalable data models and transformations using Delta Lake and open data formats
- Design and manage workflows using orchestration tools and ensure data governance and security
Required Qualifications
- 5+ years of experience in Data Engineering, particularly with Databricks
- Experience in a B2B SaaS organization
- Expertise in PySpark, SQL, and Python
- Strong knowledge of Delta Lake, Parquet, and lakehouse architectures
- Familiarity with streaming frameworks and data governance controls
Comments