Job Summary
A company is looking for a Data Engineer.
Key Responsibilities
- Maintain and improve current data pipelines for ingestion and transformation
- Design and deploy new pipelines using Python and Databricks
- Develop and manage data models with DBT to support business intelligence and analytics
Required Qualifications
- Deep knowledge of Python for scripting and data manipulation
- Strong skills in DBT, including writing complex SQL and using Jinja templating
- Hands-on experience with Databricks and Spark
- Experience with a workflow orchestration tool like Airflow
- Familiarity with AWS services and infrastructure-as-code principles using Terraform
Comments