Job Summary
A company is looking for a Databricks Contractor to contribute to the development and optimization of a data analytics platform.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Databricks and Apache Spark
- Integrate data from various sources, ensuring data quality and consistency
- Monitor and optimize the performance of data processing jobs and queries
Qualifications:
- Proven experience working with Databricks and Apache Spark
- Proficiency in Python, SQL, and Scala; experience with cloud platforms such as AWS, Azure, or Google Cloud
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience)
- Databricks certification or relevant cloud certifications
- Experience with ETL processes, data warehousing, and big data technologies
Comments