Job Summary
A company is looking for a Data Engineer to develop and implement data ingestion and distribution pipelines.
Key Responsibilities
- Develop and implement core data ingestion and distribution pipelines based on project requirements
- Troubleshoot and optimize existing workflows to enhance performance and ensure data integrity
- Demonstrate analytical and debugging skills while proactively learning new technologies
Required Qualifications
- Proficient in Python, with experience in data manipulation and transformation
- Knowledge of data integration, ETL processes, and data processing methods
- Understanding of containerization and orchestration tools like Docker and Kubernetes
- Familiarity with SQL, RDBMS, or Big Data technologies
- Experience with AWS or another cloud provider, using Terraform is a plus
Comments