Job Summary
A company is looking for a Sr Associate, Data Engineer.
Key Responsibilities
- Design, build, and maintain robust data pipelines for reliable data flow across the enterprise
- Monitor data pipeline schedules and workflows to ensure continuous data availability
- Develop and manage data cleansing, consolidation, and integration mechanisms for big data analytics
Required Qualifications
- Bachelor's Degree with a minimum of 2 years relevant experience, or a Graduate Degree with at least 1 year of experience, or 4 years of relevant experience in lieu of a degree
- 2+ years of experience designing and developing data pipelines using PySpark, Spark SQL, SQL, or Code Build
- 2+ years of experience maintaining data pipelines using Palantir Foundry
- 2+ years of experience with ETL tools such as Palantir Foundry, Azure Data Factory, or SSIS
- 3+ years of experience in Data Integration
Comments