Senior DevOps Engineer

Job Summary

A company is looking for a Sr. DevOps Engineer.

Key Responsibilities:

• Maintain and support the dedicated BigData environment, including database administration and data pruning
• Perform capacity planning, access control management, and comply with data governance policies
• Monitor, optimize, and troubleshoot system performance, including ETL processes and data storage solutions
• Develop and maintain CI/CD pipelines for efficient code testing, integration, and deployment
• Work collaboratively with engineering teams to support data management and ingestion projects

Required Qualifications:

• Strong experience in Kubernetes and Docker for scalable cloud infrastructure
• Expertise in Big Data tools (Apache Spark, Hadoop components, and data processing tools like Kafka and Airflow)
• Proficiency in scripting for automation (Python, Bash)
• Experience with CI/CD processes and tools
• Knowledge of data governance policies and practices