Azure Data engineer ( 7-10 Years),Hyderabad/ Bangalore

Job description

Dear Professionals Greetings from Tata consultancy Services, Job Title : Azure Data engineer Experience: 7-10 Years Location: Bangalore/ Hyderabad Mode of Work : Work from Office Mode of Interview: Virtual Key Responsibilities - **Pipeline Development** : Build scalable batch and real-time data pipelines using Azure Data Factory, Azure Databricks, and PySpark. - **Data Transformation** : Write optimized Python and PySpark scripts to perform complex ETL/ELT data processing. - **Architecture & Storage** : Design Data Lake architectures using ADLS Gen2, Delta Lake, and Unity Catalog frameworks. - **Performance Tuning** : Optimize Spark clusters, partitioning strategies, and complex SQL queries for cost and performance efficiency. - **CI/CD Automation** : Implement DevOps workflows and infrastructure-as-code deployments using Git and Azure DevOps pipelines. - **Data Quality** : Build validation and data reconciliation checks to ensure production data accuracy and integrity. - **Collaboration** : Work with data scientists and business stakeholders to translate analytical requirements into technical solutions Technical Requirements: - **Total Experience** : Minimum of 7 years in Data Engineering or Data Platform architecture roles. - **Core Programming** : Advanced proficiency in Python, PySpark, and Spark SQL. - **Azure Data Stack** : Deep hands-on experience with Azure Databricks, Azure Data Factory (ADF), and ADLS Gen2. - **Data Warehousing** : Solid understanding of Data Vault, Dimensional Modeling, Star/Snowflake schemas, and Delta Tables. - **Relational Databases** : Mastery of complex SQL, including Window functions, CTEs, and query optimization. - **DevOps Skills** : Practical experience with Git version control, Azure DevOps, or Jenkins. - **Bonus Skills** : Familiarity with Microsoft Fabric, Azure Synapse, or Azure Cosmos DB. If you are Interested in the above opportunity kindly share your updated resume to pullagura.gokulsaiakhil@tcs.com immediately with the details below (Mandatory) Name: Contact No. Email id: Skillset: Total exp: Relevant Exp: Fulltime highest qualification (Year of completion with percentage scored): Current organization details (Payroll company): Current CTC: Expected CTC: Notice period: Current location: Preffered Location Any gaps between your education or career (If yes pls specify the duration): Will you be able to join within 30/45 days? (Yes/NO)