Job Summary
A company is looking for a Senior Data Engineer to join their data team.
Key Responsibilities:
- Design, build, and optimize scalable data pipelines using PySpark and Python in AWS environments
- Collaborate with cross-functional teams to develop end-to-end data workflows and solutions
- Develop and maintain reusable code libraries and data engineering best practices
Required Qualifications:
- 8+ years of total software/data engineering experience
- Strong command of Python programming for data processing, API integrations, and automation
- Hands-on expertise with PySpark and SparkSQL for handling large-scale distributed data
- Deep understanding of cloud-based data architecture
- Experience with CI/CD workflows and version control (e.g., Git)
Comments