Job Summary
A company is looking for a Data Engineer to design, build, and maintain data pipelines and infrastructure.
Key Responsibilities
- Develop, construct, test, and maintain scalable data pipelines for data ingestion and transformation
- Oversee and optimize data warehouse performance and integrity
- Implement data validation and monitoring processes to ensure data reliability and accessibility
Required Qualifications
- At least 1 year of professional experience in data engineering or related fields
- Proficiency in Python for data extraction from APIs
- Experience with data orchestration tools like Dagster or Airflow
- Strong SQL and data warehouse management experience, preferably with BigQuery
- Familiarity with software engineering practices, including version control and testing
Comments