Senior Data Engineer

Job Summary

A company is looking for a Senior Data Engineer.

Key Responsibilities

• Build infrastructure for data ingestion, transformation, and loading using Spark, SQL, AWS, and Databricks
• Create an entity resolution framework to merge large datasets into clean, consumable formats
• Develop CI/CD pipelines and anomaly detection systems to enhance data quality in production

Required Qualifications

• 5-7+ years of industry experience with strategic technical problem-solving
• Strong software development fundamentals and experience with Python
• Expertise in Apache Spark and experience with SQL
• Experience building scalable data processing systems and using data pipeline orchestration tools
• Knowledge of cloud computing services and data warehousing technologies