Data Engineer

Job Summary

A company is looking for a Data Engineer to join their team remotely.

Key Responsibilities

• Ingest and integrate security and vulnerability data sources into Databricks
• Validate and standardize the data warehouse to meet security and compliance requirements
• Build and maintain streaming pipelines for real-time security monitoring data

Required Qualifications

• Strong experience with Microsoft Azure, Databricks, and Azure DevOps
• Expertise in dimensional modeling, ETL pipelines, and DBT
• Proficiency in Python for data engineering and automation
• Hands-on experience with streaming data ingestion and processing
• Experience working with vulnerability/security monitoring data ingestion and validation