Senior Data Engineer-Lakehouse

Job description

**Roles and Responsibilities :** - Design, develop, test, and deploy large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions. - Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs. - Develop complex SQL queries to optimize database performance and troubleshoot issues in existing databases. - Implement machine learning models using Python programming language to analyze large datasets. **Job Requirements :** - 8-15 years of experience in a similar role as a Senior Data Engineer or related field. - Strong expertise in Azure DevOps tools such as ADF, Azure Data Lake Storage (ADLS), and Stream Analytics. - Proficiency in SQL programming language with ability to write efficient queries for large-scale datasets.