Job Summary
A company is looking for a Sr. Data Engineer, Healthcare.
Key Responsibilities
- Design and execute Apache Spark jobs for data ingestion, transformation, and machine learning pipelines
- Develop and optimize Scala-based Spark applications, including unit tests and code reviews
- Construct scalable data pipelines in cloud ecosystems and validate pipeline outputs for compliance
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, or equivalent experience
- 5+ years of experience with big data technologies (Spark, Scala, Hadoop, Kafka, etc.)
- Deep experience with Scala in Spark, including writing functional pipelines and optimizing applications
- Proficiency in cloud platforms (AWS/Azure/GCP/OCI) and familiarity with Databricks and Snowflake
- Prior experience in healthcare data is preferred
Comments