JobScans.in

Job description

Job Description - -------------- Job Description: Data Engineer Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minimum of 9-12 years in designing and implementing modern data solutions. The ideal candidate will have strong expertise in Azure Data Factory, mini data lake architectures, Snowflake, Azure Synapse Analytics, and ETL/ELT processes. This role involves building scalable data pipelines, optimizing workflows, and enabling advanced analytics for enterprise-grade solutions. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and SSIS. Implement and manage mini data lake solutions on Azure for efficient ingestion and storage. Build and optimize data models in Snowflake and Azure Synapse Analytics. Integrate data from multiple sources ensuring quality, consistency, and governance. Monitor and tune pipelines for scalability and cost efficiency. Implement automated workflows and deployment pipelines using Azure DevOps. Partner with BI teams, data scientists, and business stakeholders to deliver actionable insights. Maintain clear documentation of data flows, schemas, and governance policies. Required Skills and Qualifications Minimum 6 years in data engineering with strong exposure to cloud-based data platforms. Advanced pipeline design and orchestration using Azure Data Factory (ADF). Proficient in Snowflake \& Synapse for data modeling and query optimization. Hands-on experience with SSIS and modern ETL/ELT frameworks. Experience in mini data lake design and management on Azure. Strong SQL skills and familiarity with Python or PowerShell for automation. Knowledge of deployment automation and version control (Git). Excellent analytical, problem-solving, and communication skills. Preferred Skills Experience with Azure Databricks or other big data processing frameworks. Familiarity with data governance tools and data cataloging. Exposure to real-time data streaming (Azure Service Bus, Kafka, Event Hub). Knowledge of performance tuning for large-scale data systems. Certifications Microsoft Certified: Azure Data Engineer Associate Snowflake SnowPro Core Certification Any relevant Azure or Data Engineering certifications Key Performance Indicators (KPIs) Timely delivery of data pipelines and integration projects. Data accuracy and quality in all ETL/ELT processes. Performance optimization of data workflows and queries. Successful implementation of automation and CI/CD pipelines. Stakeholder satisfaction and collaboration effectiveness. Compliance with data governance and security standards.