Job Summary
A company is looking for a Data Engineer to design and maintain scalable data infrastructure.
Key Responsibilities
- Design and build infrastructure on top of CDC from PostgreSQL to S3, Spark, Parquet, ClickHouse
- Maintain data infrastructure for analytics
- Formulate requirements for new data sources and integrate them into existing aggregate data models
Required Qualifications
- 3+ years of experience in data engineering
- Hands-on experience with the AWS cloud stack
- Experience working with PostgreSQL, S3, Spark, Airflow, Parquet, and ClickHouse
- Experience designing data marts and developing ETL processes
- Proficiency in or a desire to learn Python
Comments