Job Summary
A company is looking for a Data Engineer II to build and maintain scalable data pipelines and support analytics initiatives.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks, Apache Spark, and Python
- Collaborate with data engineering teams to integrate data from various source systems to Azure
- Ensure data quality, integrity, and security throughout the data pipeline and Lakehouse architecture
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
- 5+ years of experience in cloud development practices
- Strong expertise in cloud platforms (AWS, Azure, GCP) and virtualization
- Preferred experience with infrastructure automation tools (Terraform, Ansible, Kubernetes)
- Knowledge of cybersecurity best practices and disaster recovery planning
Comments