Job Summary
A company is looking for a Senior Data Engineer to support data ingestion, processing, and synchronization across its analytics platform.
Key Responsibilities
- Build and maintain Python Notebooks to ingest data from third-party APIs
- Design and implement Medallion layer architecture for structured data organization
- Store and manage data within Microsoft Fabric's Data Lake and Warehouse
Required Qualifications
- Strong experience with Python for data ingestion and transformation
- Proficiency with PySpark for large-scale data processing
- Experience with Microsoft Fabric or similar modern data platforms
- Understanding of Medallion architecture and data lakehouse concepts
- Familiarity with cloud-based workflows, especially within the Azure ecosystem
Comments