Job Summary
A company is looking for a Data Engineer.
Key Responsibilities
- Support data modernization efforts by enhancing report conversion and data pipeline efficiency
- Manage and optimize Databricks clusters and job scheduling
- Ensure data integrity and accessibility across the organization
Required Qualifications
- 3+ years of hands-on experience with Databricks and cluster management
- 5+ years of experience in PySpark or Scala for data engineering tasks
- 5+ years of experience building efficient ETL pipelines using Azure Data Factory or similar
- Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field
- Relevant industry certifications in Databricks or Azure Cloud
Comments