Job Summary
A company is looking for a Staff Data Engineer to help scale and strengthen its data platform.
Key Responsibilities
- Develop and maintain data pipelines and transformations across the data stack
- Tune performance, storage layout, and cost-efficiency of data storage and query engines
- Design and implement new data ingestion patterns while improving platform observability and reliability
Required Qualifications
- 8-10+ years of experience building and maintaining data pipelines in production environments
- Strong knowledge of AWS data services, particularly Glue, S3, Athena/Trino/PrestoDB, and Aurora
- Proficiency in Python, Spark, and Athena/Trino/PrestoDB for data transformation and orchestration
- Experience managing infrastructure with OpenTofu/Terraform or other Infrastructure-as-Code tools
- Solid understanding of data modeling, partitioning strategies, schema evolution, and performance tuning
Comments