Job Summary
A company is looking for a Data Engineer.
Key Responsibilities
- Design and build scalable data pipelines using tools like Airflow, Spark, and Kafka
- Monitor and implement systems for data quality and issue detection
- Support data governance and lineage initiatives across data pipelines
Required Qualifications
- 3+ years of data engineering experience with on-premise systems (e.g., Spark, Hadoop)
- Hands-on experience troubleshooting systems and pipelines for performance and scaling
- Proficient in Python or Java/Scala and knowledgeable in SQL and various database/query dialects
- Familiarity with CI/CD processes and software containerization
- Desirable experience in data governance, data lineage, and data quality initiatives
Comments