SENIOR DATA ARCHITECT - Azure Databricks

Job description

We are seeking an experienced Data Architect with strong expertise in Databricks platform implementations to support enterprise-scale data modernization and analytics initiatives. The ideal candidate will lead the architecture, design, and implementation of scalable cloud-based data platforms and provide technical leadership across data engineering, governance, integration, and analytics workstreams. The role requires hands-on experience in cloud data platforms, lakehouse architecture, enterprise integrations, and modern data engineering practices. Key Responsibilities Architecture & Solution Design - Design scalable enterprise data platform architectures using Databricks Lakehouse principles - Define end-to-end data architecture for batch and real-time processing - Develop data ingestion, transformation, storage, and consumption frameworks - Create logical and physical data models aligned with business requirements - Define enterprise integration patterns for APIs, ERP, IoT, operational, and third-party systems Platform Engineering & Governance - Establish platform standards, security frameworks, and governance models - Define RBAC, data access controls, and security best practices - Implement monitoring, logging, and observability standards - Support CI/CD, DevOps, and Infrastructure-as-Code practices - Drive data quality, metadata, lineage, and cataloging initiatives Cloud & Performance Optimization - Optimize Databricks clusters, Spark workloads, and storage utilization - Recommend cost optimization and scalability strategies - Support cloud-native architecture patterns across Azure/AWS/GCP environments - Design high availability and disaster recovery strategies Stakeholder Collaboration - Work closely with business stakeholders, data engineers, analysts, and project managers - Conduct architecture reviews and technical workshops - Provide technical leadership and mentoring to delivery teams - Support estimation, planning, and technical governance activities Delivery & Support - Participate in agile ceremonies and technical design discussions - Support deployment planning and production readiness activities - Assist in troubleshooting critical platform and performance issues - Ensure adherence to enterprise architecture standards and compliance requirements - Preferred Qualifications - Experience in Oil & Gas, Energy, Utilities, or Industrial sectors - Knowledge of IoT, telemetry, sensor, or operational data platforms - Experience integrating enterprise applications and operational systems - Exposure to data migration and modernization programs - Databricks and cloud platform certifications preferred - Experience Requirements - 8+ years of overall experience in data engineering and data architecture - 5+ years of experience in cloud data platform implementations - 3+ years of hands-on Databricks architecture experience - Proven experience leading enterprise-scale data platform programs Azure Databricks