Data Engineer

Job Summary

A company is looking for a Data Engineer to support the design, configuration, and maintenance of machine learning environments.

Key Responsibilities

• Design, configure, and maintain ML development and production environments
• Administer and troubleshoot Hadoop ecosystem components and perform Linux system administration
• Collaborate with cross-functional teams to deploy ML models and monitor performance

Qualifications

• 1-2 years of experience with Hadoop (HDFS, YARN, MapReduce)
• 1-2 years of Linux experience, including Bash scripting
• 1-2 years working with security protocols like SSL and Kerberos
• 1-4 years of Python experience for scripting and data engineering
• 2-3 years of hands-on experience with Azure Data Factory and related Azure services