Job Summary
A company is looking for a Staff Data Engineer.
Key Responsibilities:
- Develop data pipelines for ingesting large amounts of data from various sources
- Evolve data architecture and support current pipelines and legacy systems
- Collaborate with stakeholders to leverage company data for search and recommendations
Required Qualifications:
- BS or MS in Computer Science or related field with 10+ years of software development experience
- Experience with Apache Spark, Scala, and PySpark, and building production-grade batch pipelines
- At least 4+ years of experience in Java and API/Microservices
- 2+ years of experience in Python and complex SQL for ETL processes
- Knowledge of big data technologies and experience with AWS stack
Comments