Job Summary
A company is looking for a Data Architect, Remote.
Key Responsibilities:
- Design, develop, and optimize large-scale data pipelines using Apache Spark and Databricks
- Write scalable PySpark code to process structured and semi-structured data
- Implement data validation and quality checks using Deequ
Qualifications:
- 15+ years of IT experience
- Experience with Databricks (highly preferred)
- Proficiency in PySpark
Comments