Pipeline Engineer

Job Summary

A company is looking for a Pipeline Engineer.

Key Responsibilities

• Design, develop and maintain robust file processing pipeline infrastructure
• Orchestrate the flow of data through various stages of processing
• Integrate data from various sources including industry storage platforms and external APIs

Required Qualifications

• BS/MS in Computer Science, Information Systems, or a related field
• 5+ years of experience in ETL development and data engineering
• Strong coding proficiency in Python and database systems (SQL, noSQL)
• Experience with pipeline orchestration tools and infrastructure-as-code
• Understanding of serverless architectures and familiarity with ML workflows