Job Summary
A company is looking for a Big Data Engineer.
Key Responsibilities
- Participate in the design and development of data solutions for challenging projects
- Develop projects from scratch with minimal supervision and strong team collaboration
- Develop ETLs using Spark (Python/Scala) and build scalable pipelines using various technologies
Required Qualifications
- At least 3 years of experience in data engineering
- Strong experience with Python or Scala and Spark, processing large datasets
- Solid experience in cloud platforms (Azure or AWS)
- Hands-on experience building data pipelines (CI/CD)
- Knowledge of SQL and NoSQL databases
Comments