Azure Databricks Engineer

Job description

Area(s) of responsibility - ------------------------ Skills: Azure Databricks Engineer, Python, Pyspark, SQL Experience: 6-12years • Azure Lead with experience in Azure ADF, ADLS Gen2, Databricks, PySpark and Advanced SQL • Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on Azure Cloud • 4 Years of experience in Azure Databricks and PySpark • Experience in Performance Tuning • Experience with integration of different data sources with Data Warehouse and Data Lake is required • Experience in creating Data warehouse, data lakes • Understanding of data modelling and data architecture concepts • To be able to clearly articulate pros and cons of various technologies and platforms • Experience in supporting tools GitHub, Jira, Teams, Confluence need to be used • Collaborate with clients to understand their business requirements and translate them into technical solutions that leverage AWS and Azure cloud platforms. Mandatory Skillset: Azure Databricks, PySpark and Advanced SQL