Databricks + PySpark - Technical Lead-Data Engg
Birlasoft · State of Mahārāshtra, India
Birlasoft · State of Mahārāshtra, India
Country/Region: IN Requisition ID: 38123 Work Model: Position Type: Salary Range: Location: INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI # **Title:** **Databricks + PySpark - Technical Lead-Data Engg** Description: ## **Area(s) of responsibility** - Experience in Perform Design, Development & Deployment using Azure Services (**Databricks, PySpark**, SQL, Data Factory,) - Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity. - Experience in creating **Technical Specification Design**, Application Interface Design. - Developing Modern Data Warehouse solutions using Azure Stack (**Azure Data Lake**, **Azure Databricks) and PySpark** - Develop batch processing and integration solutions and process Structured and Non-Structured Data - Demonstrated in-depth skills with **Databricks and PySpark,** and SQL - Collaborate and engage with BI & analytics and the business team. - Minimum 2 to 3 year of Project experience in Azure Databricks - Minimum 2-3 years of experience in ADF - Minimum 2+ years of experience in PySpark **Location: Mumbai, Pune, Noida, Bangalore**