Job Summary
A company is looking for a Data Engineer to join their dynamic team in Denver, Colorado.
Key Responsibilities
- Develop and maintain scalable data pipelines and systems using Scala, Python, Spark, and Databricks
- Design and implement unified data models ensuring enterprise-wide consistency
- Optimize operations in Spark for handling large, unstructured, and nested datasets
Qualifications
- Extensive experience as a Data Engineer, focusing on Python programming in Spark/Databricks environments
- Proven expertise in designing and optimizing large-scale data pipelines and ETL processes
- Strong background in cloud platforms, ideally Azure, with experience managing cloud-based data infrastructure
- Demonstrated ability to convert legacy systems into modern Spark/Databricks platforms
- Experience with data quality monitoring systems
Comments