Data Engineer

Job Summary

A company is looking for a Data Engineer.

Key Responsibilities

• Design and implement data processing pipelines for real-time and batch data
• Utilize Python and Spark for ETL workflows and large-scale data loads
• Ensure data quality and accuracy across various data platforms and integration processes

Required Qualifications

• 5+ years of experience in heavy-volume data processing and data platforms
• 3+ years of proficiency in Python and Spark
• 3+ years of hands-on experience with ETL workflows using Spark and Python
• Experience with SQL/NoSQL databases and data lakes
• Familiarity with Kafka streams and Databricks or equivalent data platforms