Job Summary
A company is looking for a Data Engineer (Poland Remote).
Key Responsibilities
- Develop reusable, metadata-driven data pipelines and automate data platform processes
- Build integrations with data sources and data consumers, and add data transformation methods to shared ETL libraries
- Proactively resolve performance or quality issues in ETL processes and contribute to data platform documentation
Required Qualifications
- Proficient in Python/PySpark and SQL
- Experienced in building data pipelines using Databricks Spark
- Knowledgeable about data transformation modules organized as libraries
- Familiar with Databricks Delta optimization techniques
- Experienced in developing CI/CD pipelines and leveraging event brokers for data integration
Comments