Job Summary
A company is looking for a Data Engineer - Platform.
Key Responsibilities
- Collaborate with teammates to design and implement a data platform
- Develop and maintain dbt framework and API services for core metrics and forecasts
- Write and maintain efficient Airflow/Spark/Flink jobs for data cleaning and enrichment
Required Qualifications
- Experience building and maintaining data pipelines at scale
- Experience running data workloads in the cloud, specifically GCP
- Proficiency with Airflow, Flink, BigQuery, and SQL
- Familiarity with multiple databases, including MySQL and MongoDB
- Experience deploying infrastructure as code using Terraform
Comments