Azure Data Platform Engineer - Databricks & DevOps

Job description

**Key Responsibilities** - Build, deploy, and operate enterprise data platform services using: - Azure Databricks - Azure Data Factory (ADF) - Azure Data Lake Storage Gen2 (ADLS) - Implement and maintain Infrastructure-as-Code using: - Terraform - ARM Templates - Bicep - Develop and manage CI/CD pipelines for platform deployments and releases - Ensure platform reliability, scalability, and operational stability in production environments - Implement monitoring, logging, alerting, and observability solutions - Manage platform security, access controls, governance, and compliance standards - Optimize platform performance and cloud consumption using FinOps best practices - Collaborate with Data Engineers, Architects, and Cloud Engineering teams - Support troubleshooting, incident management, and root-cause analysis - Create and maintain operational documentation, standards, and runbooks **Must-Have Skills** Azure Data Platform - Strong hands-on experience with: - Azure Databricks - Azure Data Factory (ADF) - ADLS Gen2 - Experience supporting enterprise-scale Azure data platforms Infrastructure & DevOps - Experience with: - Terraform - ARM Templates - Bicep - Strong understanding of: - CI/CD pipelines - Infrastructure automation - DevOps best practices Programming & Database - Proficiency in: - Python - SQL - Experience supporting data engineering workloads Platform Operations - Experience with: - Monitoring and observability - Production support - Reliability engineering - Performance optimization Security & Governance - Strong understanding of: - Identity and access management - Data security - Platform governance - Compliance controls **Good-to-Have Skills** - Experience with: - FinOps and cloud cost optimization - Azure Monitor and Log Analytics - GitHub Actions or Azure DevOps - Spark/PySpark environments - Exposure to: - Enterprise data warehouse and analytics platforms