Job Summary
A company is looking for a Big Data Engineer specializing in massive data.
Key Responsibilities
- Design, develop, and maintain data ingestion pipelines for image/video/GIS data
- Implement and manage data workflows using Apache Airflow for efficient data processing
- Architect and manage scalable cloud data storage solutions and optimize performance
Required Qualifications
- BS in computer science or equivalent degree with at least 10 years of experience in data engineering
- Significant experience with Python and Java/Scala programming languages
- Experience in creating/supporting APIs and throughput optimization
- Experience architecting cloud-native distributed systems handling massive data
- Good understanding of data structures and multi-threaded programming
Comments