Azure Databricks+ PySpark- Sr Technical Lead-Data Engg
Birlasoft · Pune/Pimpri-Chinchwad Area
Birlasoft · Pune/Pimpri-Chinchwad Area
Area(s) of responsibility **Azure Data Engineer with Databricks and PySpark** **Job Description** **Years of experience 8 to 10 Years – 5B – Sr Tech Lead** - Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,) - Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity. - Experience in creating Technical Specification Design, Application Interface Design. - Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark - Develop batch processing and integration solutions and process Structured and Non-Structured Data - Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL - Collaborate and engage with BI & analytics and the business team. - Minimum 2 to 3 year of Project experience in Azure Databricks - Minimum 2-3 years of experience in ADF - Minimum 2+ years of experience in PySpark **Location: Mumbai, Pune, Noida, Bangalore and Chennai**