Job Summary
A company is looking for an Application Developer.
Key Responsibilities
- Create ETL pipelines using Dataflow and BigQuery, ensuring best practices for performance
- Write complex SQL queries with a focus on execution cost efficiency
- Implement and manage partitioned tables for daily batch processing and fine-grained access control
Required Qualifications
- 7+ years of relevant experience preferred
- Proficiency in creating and managing ETL jobs using BigQuery
- Hands-on experience with DAG using YAML or Airflow (Python)
- In-depth understanding of BigQuery architecture, including table partitioning and clustering
- Knowledge of Python programming
Comments