Job Summary
A company is looking for a Data Engineer.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines using Azure Databricks and Azure Data Factory
- Build and optimize data lakes and backend architectures for large datasets
- Ensure HIPAA compliance when working with PHI/PII by implementing data privacy and security measures
Required Qualifications
- 5+ years experience in Azure Databricks and ETL development
- Strong experience with Azure Data Factory for data orchestration and automation
- Proven expertise in ETL automation for large, complex datasets
- Solid Python programming skills for data engineering tasks
- Experience working with healthcare or pharma data, including PHI/PII, and ensuring compliance with HIPAA
Comments