Job Summary
A company is looking for a Senior Data Engineer to design, build, and maintain data platforms.
Key Responsibilities
- Design, build, and maintain scalable data pipelines for batch and real-time processing
- Implement data ingestion frameworks, including change data capture from various systems
- Ensure data quality, governance, and security using Unity Catalog and CI/CD practices
Required Qualifications
- 5+ years of professional experience in data engineering, preferably in insurance or financial services
- Proficiency in Python, SQL, and Spark for building data pipelines
- Hands-on experience with Databricks and/or Azure Data Services
- Strong experience with AWS data services and familiarity with modern data architectures
- Comfortable with GitHub, CI/CD pipelines, and testing frameworks
Comments