Data Engineer II

Job Summary

A company is looking for a Data Engineer II.

Key Responsibilities

• Transform large data into business databases and applications for analytics and reporting
• Develop and automate ETL jobs using various tools and AWS services
• Collaborate with business and technical teams to ensure data quality and relevance

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field
• One year of experience in data analysis using SQL and Spark SQL
• Experience developing ETL jobs with Databricks, Jupyter, and Pyspark
• Knowledge of AWS services including S3, Athena, Lambda, RDS, Glue, and EMR
• Experience performing data quality checks and exploratory data analysis using PySpark