Job Summary
A company is looking for a Data Engineer.
Key Responsibilities
- Design, build, and maintain scalable data pipelines and ETL processes
- Develop and automate workflows for data ingestion, transformation, and delivery
- Implement monitoring and observability for data pipelines and ensure data governance and quality
Required Qualifications
- 7-8 years of relevant experience or a Master's degree in a related field
- Strong proficiency with SQL, Python, and PySpark
- Hands-on experience with cloud computing technologies, preferably Azure
- Experience with CI/CD pipelines and orchestration tools
- Must have Databricks experience
Comments