Azure Data Engineer (PAN India)

Job description

We are seeking an experienced **Senior Azure Data Engineer** with strong expertise in **Azure Data Factory (ADF), Data Flows, Azure Databricks, and CI/CD pipeline development**. The ideal candidate will be responsible for designing and developing scalable data ingestion and transformation solutions while supporting enterprise data architecture initiatives within a banking environment. **Key Responsibilities** - Design, develop, and maintain enterprise-scale data pipelines using Azure Data Factory (ADF), Data Flows, and Azure Databricks. - Build and support CI/CD pipelines for data engineering solutions. - Develop robust data ingestion frameworks to process data from on-premises systems, cloud platforms, APIs, files, and databases. - Implement data quality validation and monitoring controls across data pipelines. - Work closely with Business Data Architects and Enterprise Architects to align solutions with target-state architecture. - Support the design and implementation of data ingestion frameworks following banking and enterprise standards. - Develop scalable, reusable, and high-performance data engineering solutions. - Guide and mentor team members on best practices, coding standards, and solution design principles. - Collaborate with business and technology teams to gather requirements and deliver high-quality data solutions. - Participate in Agile ceremonies including sprint planning, estimation, reviews, and retrospectives. - Ensure compliance with security, governance, and data management standards. **Required Skills** - Strong hands-on experience with Azure Data Factory (ADF). - Experience with Azure Data Flows and Azure Databricks. - Expertise in building and maintaining data pipelines and ETL/ELT solutions. - Experience building CI/CD pipelines for data platforms. - Strong understanding of data ingestion from APIs, files, databases, and cloud/on-premise systems. - Experience implementing data quality controls and validation frameworks. - Knowledge of enterprise data architecture and data integration patterns. - Experience working in Agile development environments. - Strong stakeholder management and communication skills. **Preferred Skills** - Banking or Financial Services domain experience. - Azure Data Lake (ADLS). - Azure DevOps. - SQL and performance optimization. - Data Warehousing and Data Modelling concepts. - Cloud-native data architecture experience. **Desired Candidate Profile** - Strong problem-solving and analytical skills. - Ability to mentor and guide junior engineers. - Excellent communication and collaboration abilities. - Experience working with cross-functional teams and enterprise architects. - Proactive mindset with focus on scalable and reusable engineering solutions.