Azure DataBricks

Job description

**Role & responsibilities.** Job Summary We are looking for an experienced Azure Data Engineer with strong expertise in Azure Data Platform, Databricks, PySpark, Python, and SQL. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and data engineering solutions to support enterprise analytics and business intelligence initiatives. Key Responsibilities - Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark. - Build and optimize ETL/ELT workflows for structured and unstructured data. - Develop robust data processing solutions using Python and SQL. - Work with Azure services such as Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL. - Implement data quality, performance tuning, and optimization techniques. - Collaborate with cross-functional teams, including architects, business analysts, and data scientists. - Ensure data security, governance, and compliance with organizational standards. - Troubleshoot production issues and provide timely resolutions. - Participate in code reviews and follow best practices for development and deployment.