Azure Databricks Solution Architect

Job description

Educational Requirements Bachelor of Engineering,BTech,BCA,BSc,ME,MTech,MCA,MSc,MBA Service Line Data Analytics Unit Responsibilities - Lead architecture, design, and implementation of enterprise-scale Azure Databricks solutions. - Define and govern modern Data Engineering and Data Architecture standards. - Design scalable ETL/ELT frameworks, data pipelines, and cloud-native data platforms. - Architect solutions using Azure Databricks, PySpark, Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics. - Build and optimize large-scale Data Lake, Delta Lake, and Lakehouse Architecture implementations. - Drive cloud migration and modernization initiatives from legacy platforms to Azure. - Collaborate with business leaders, enterprise architects, and delivery teams to define solution roadmaps. - Lead performance optimization, scalability improvements, and platform modernization efforts. - Establish best practices around Data Governance, Security, Data Quality, and Compliance. - Support project estimation, solution reviews, architecture governance, and technical presales activities. - Mentor Data Engineers and technical teams on Azure and Databricks best practices. - Evaluate emerging Azure and Databricks capabilities to enable innovation and platform optimization. Required Skills - 1214 years of experience in Data Engineering, Data Architecture, and Cloud Data Platforms. - Strong expertise in Azure Databricks and enterprise-scale Databricks implementations. - Deep hands-on experience with PySpark, Apache Spark, Spark SQL, Python, and SQL. - Extensive knowledge of Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure ecosystem services. - Proven experience designing and implementing Lakehouse Architecture and Delta Lake solutions. Technical and Professional Requirements: - Experience with Azure Synapse Analytics and enterprise analytics platforms. - Exposure to Structured Streaming, Real-Time Data Processing, and Event-Driven Architectures. - Knowledge of Medallion Architecture and modern Data Mesh concepts. - Experience with multi-cloud environments including AWS and GCP. - Familiarity with Infrastructure as Code (Terraform, ARM Templates). - Experience leading cloud migration and digital transformation programs. Preferred Skills: - Technology->Cloud Platform->Azure Networking Services->Azure;CDN - Technology->Data Engineering->Databricks - Technology->Big Data - Data Processing->PySpark