Databricks Developer

Job description

**Job DetailsRole:** Databricks Engineer **Experience:** 5+ Years **Locations:** Pune **Required Skills** - Azure Databricks - PySpark - ADLS (Azure Data Lake Storage) - Python - SQL - Azure Cloud Technologies **Key Responsibilities** - Design, develop, and maintain scalable **Databricks data pipelines**. - Transform and process large-scale datasets using **Azure Databricks** and **Delta Lake**. - Implement Big Data solutions in cloud ecosystems, including **Data Lakes** and **Delta Lakes**. - Develop and optimize complex SQL queries for high-volume data processing. - Perform data analysis and troubleshoot data-related issues to ensure data quality and reliability. - Implement integration solutions using Microsoft Azure services. - Participate in Agile development practices, including sprint planning, development, and delivery. - Support Azure DevOps processes, including Stories, Bugs, and Issue Management. **Technical Requirements** - Strong hands-on experience in **Azure Databricks (Python)**. - Proficiency in **PySpark** for distributed data processing. - Experience working with **Azure Data Lake Storage (ADLS)**. - Expertise in designing and building end-to-end data pipelines. - Experience with **Delta Lake** and data transformation frameworks. - Strong SQL skills with the ability to write complex and optimized queries. - Hands-on experience implementing Big Data solutions in Azure cloud environments. - Strong analytical and complex problem-solving abilities. - Experience working in Agile project environments and sprint-based deliveries.