Databricks Engineer

Job description

Job Title: Databricks Engineer About HCLTech HCLTech is a global technology leader known for delivering innovative and transformative digital solutions across industries. With a strong focus on customer success, cutting-edge research, and sustainable practices, HCLTech empowers organizations to accelerate their digital journey and drive business value on a scale. Role Overview We are seeking a skilled Databricks Engineer to design, develop, and optimize data solutions on the Microsoft Azure platform. This role is critical in enabling data-driven decision-making by building scalable data pipelines, integrating diverse data sources, and delivering high-quality analytics solutions aligned with business objectives. Key Responsibilities • Design and develop scalable data solutions using Azure Databricks and the Azure ecosystem • Build and manage Azure Data Factory (ADF) pipelines for efficient data ingestion and transformation • Integrate structured and unstructured data from multiple sources into Azure Data Lake / Analytics platforms • Develop ETL processes to support analytics and reporting requirements • Collaborate with cross-functional teams to deliver high-quality data solutions • Translate business requirements into technical designs and implement scalable architecture • Ensure performance optimization, data quality, and reliability across data pipelines • Support deployment and version control using Azure DevOps Mandatory Skills • Strong expertise in Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS) • Hands-on experience with: • Azure Data Factory (ADF) • Azure Databricks • Azure Synapse Analytics • Azure DevOps • Azure Storage / Data Lake • Solid understanding of ETL processes and data integration • Proficiency in SQL and relational databases • Strong analytical and problem-solving skills Preferred Skills (Good to Have) • Experience with Python scripting and Spark APIs • Exposure to client-facing roles and stakeholder interactions • Familiarity with Agile / Scrum methodologies Educational Qualification • Bachelors degree in Computer Science / Information Technology / related field Skill Evaluation Matrix (Snapshot) • Azure Stack, ADF, Databricks, Synapse, ETL, SQL – Core strengths required • DevOps, Storage/Data Lake – Supporting capabilities • Python/Spark, Client Engagement, Agile – Added advantage