Tcs Walkin- Azure Data Engineer- 11th July- Tcs Mumbai

Job description

**Azure Data Engineer** **Job Summary** We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will be responsible for building and optimizing data pipelines, integrating data from multiple sources, implementing data warehousing solutions, and ensuring data quality, security, and governance. The role requires strong expertise in Azure data services, SQL, ETL/ELT processes, and big data technologies. **Key Responsibilities** - Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Azure services. - Develop and manage data integration solutions using Azure Data Factory (ADF). - Build and optimize data lakes and data warehouses using Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL Database. - Implement data processing solutions using Azure Databricks, Apache Spark, and PySpark. - Perform data modeling, transformation, and optimization for analytical and reporting requirements. - Ensure data quality, integrity, security, and governance across all data platforms. - Monitor and troubleshoot data workflows, pipeline failures, and performance issues. - Collaborate with business stakeholders, data analysts, data scientists, and application teams to understand data requirements. - Develop reusable frameworks, coding standards, and best practices for data engineering. - Implement CI/CD pipelines and DevOps practices for data platform deployments. - Create technical documentation, data dictionaries, and operational runbooks. - Support cloud migration and modernization initiatives involving data platforms. **Required Skills & Qualifications** - Bachelor's degree in Computer Science, Information Technology, Engineering, or related field. - 3+ years (or relevant experience based on role level) in Data Engineering. - Strong experience with Microsoft Azure cloud platform. - Expertise in Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage (ADLS). - Strong SQL development and database optimization skills. - Hands-on experience with Python, PySpark, or Scala. - Experience building ETL/ELT pipelines and data integration solutions. - Understanding of data warehousing concepts and dimensional modeling. - Knowledge of Azure SQL Database, SQL Server, or other relational databases. - Familiarity with Azure DevOps, Git, and CI/CD practices. - Strong analytical, problem-solving, and communication skills. **Preferred Qualifications** - Microsoft Azure certifications such as: - DP-203: Azure Data Engineer Associate - AZ-900: Azure Fundamentals - Experience with Power BI and reporting solutions. - Knowledge of streaming technologies such as Azure Event Hub, Azure Stream Analytics, or Kafka. - Experience working with large-scale data processing and big data technologies. - Exposure to data governance, security, and compliance frameworks. Technical Skills - **Cloud Platform:** Microsoft Azure - **Data Integration:** Azure Data Factory (ADF) - **Data Storage:** Azure Data Lake Storage (ADLS), Azure SQL Database - **Big Data:** Azure Databricks, Apache Spark, PySpark - **Data Warehousing:** Azure Synapse Analytics - **Programming:** Python, PySpark, SQL - **Version Control:** Git - **DevOps:** Azure DevOps, CI/CD - **Reporting:** Power BI (Preferred) Soft Skills - Strong communication and stakeholder management skills. - Ability to work in Agile/Scrum environments. - Excellent analytical and problem-solving abilities. - Strong collaboration and teamwork mindset. - Ability to manage multiple priorities in a fast-paced environment.