Databricks, Azure, ADF, Spark

Job description

**Virtual Drive 18th July 2026** **Skill : Databricks, Azure, ADF, Spark** **Hyderabad / Chennai** **8: to 12 years of experience** **30 days Notice** - Design and architect scalable data processing solutions using Databricks and PySpark (Spark Streaming not DLT). - Develop and maintain data pipelines, ensuring data quality and reliability. - Implement data orchestration workflows using Azure Event Hubs and Azure Event Grid. - Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and deliver solutions. - Optimize and tune Spark queries for performance and efficiency. - Ensure data security and compliance with industry standards and best practices. - Provide technical guidance and mentorship to junior team members. - Stay updated with the latest trends and advancements in Databricks, PySpark, and Azure services. **Qualifications:** - Proven experience as a Databricks Lead or similar role. - Strong expertise in Databricks, PySpark, and Spark SQL. - Experience with Azure services, including Azure Event Hubs and Azure Event Grid. - Proficiency in designing and implementing data processing pipelines. - Knowledge of data warehousing concepts and ETL processes. - Familiarity with data security and compliance best practices. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills.