Data Engineer

Job Summary

A company is looking for a Data Engineer to manage the data engineering lifecycle and build data pipelines.

Key Responsibilities

• Oversee the entire data engineering lifecycle including research, design, development, and maintenance
• Build automated, scalable data and analytic pipelines with monitoring and reporting features
• Maintain documentation for data definitions and processes to ensure governance and security

Required Qualifications

• 4+ years of experience in software engineering using Spark with Python and SQL
• 4+ years of experience with cloud platforms (Azure/AWS/GCP) and tools like Databricks and Snowflake
• 4+ years of experience in data engineering including ETL and pipeline development
• 1+ years of experience working with healthcare data
• Experience with data orchestration tools such as ADF, Airflow, and DBT