T

Azure Databricks & Integration Engineer

Tata Consultancy Services · Bengaluru, Karnataka, India - Chennai, Tamil Nadu, India - Hyderabad, Telangana, India

~₹13L (est.)4–10 yrs experiencefull_timePosted Yesterday
Apply now →

Job description

Azure Databricks & Integration Engineer **Experience:** 6-10 Years **Locations:** Chennai, Bengaluru, Hyderabad, Pune, Kochi, Kolkata, NCR/Delhi **Interview Mode:** Virtual Interview **Interview Date:** 8th August 2026 (Saturday) **Job Description** We are looking for a skilled **Azure Databricks & Integration Engineer** with experience in designing, developing, and supporting enterprise-scale data integration and analytics solutions on the Azure platform. The ideal candidate should have expertise in Azure Databricks, Azure Data Factory, ETL/ELT processes, and cloud-based data engineering solutions. **Key Responsibilities** - Design and develop scalable data pipelines using **Azure Databricks** and Azure integration services. - Build and optimize ETL/ELT solutions for ingesting, transforming, and processing large datasets. - Develop data integration workflows using **Azure Data Factory (ADF)** and related Azure services. - Implement data processing solutions using **PySpark, Spark SQL, and Databricks**. - Work closely with architects, business stakeholders, and data teams to deliver data-driven solutions. - Ensure data quality, performance, security, and governance standards. - Troubleshoot and optimize existing data platforms and integration processes. - Support CI/CD implementation and cloud deployment best practices. **Required Skills** - 6-10 years of experience in Data Engineering and Integration. - Strong hands-on experience with **Azure Databricks**. - Expertise in **Azure Data Factory (ADF)** and data integration solutions. - Strong knowledge of **PySpark, Spark SQL, Python, and SQL**. - Experience with ETL/ELT development and data transformation processes. - Knowledge of Azure Data Lake, Azure Storage, and cloud-native architectures. - Experience with DevOps, CI/CD pipelines, and Git-based version control. - Strong problem-solving and analytical skills. **Preferred Skills** - Experience with Delta Lake and Databricks Lakehouse architecture. - Exposure to Azure Synapse Analytics. - Knowledge of streaming technologies such as Kafka and Event Hubs. - Experience working in large-scale enterprise data environments. ***If you are interested in this opportunity and available to attend the virtual interview on 8th August, kindly apply at the earliest.*** ***Post receiving your application, I will connect with you for data collection and discuss the further steps in the hiring process***