Azure Data Engineer - Pan India - 15 May (Friday) - Virtual Interview

Job description

**Job Description:** Required Technical Skill : SQL, Python (PySpark), ADF, Azure Databricks, Familiarity with CI/CD pipelines, Git, and Infrastructure Must Have Experience in Azure Data Services: Hands on core services like Azure Data Factory (ADF) for orchestration, Azure Synapse Analytics for warehousing, Azure Databricks for big data processing, and Azure Data Lake Storage (ADLS) Gen2. Programming Languages: Proficiency in SQL for database management and Python or PySpark for data transformation and analysis is essential. Engineering: Familiarity with ETL/ELT processes, data modeling (Star/Snowflake schemas), and DevOps (CI/CD with Azure DevOps) to ensure pipeline reliability. Responsibility: 1 Pipeline Development & Orchestration: Designing and implementing automated ETL/ELT workflows using Azure Data Factory (ADF) to move data from various sources (APIs, logs, databases) to centralized storage. 2 Data Transformation: Cleaning, standardizing, and aggregating raw datasets using Azure Databricks or Spark notebooks to ensure data accuracy and quality. 3 Storage Management: Setting up and managing scalable cloud storage like Azure Data Lake Storage (ADLS) Gen2 and Azure Blob Storage to handle structured and unstructured data. 4 Data Warehousing: Designing and optimizing analytical schemas (e.g., Star or Snowflake) in Azure Synapse Analytics to support high-performance reporting. 5 Monitoring & Troubleshooting: Checking overnight automated reports for pipeline failures and resolving bottlenecks to ensure high data availability. **Human Resources - TCS** **Talent Acquisition Group** **Tata Consultancy Services** **Let's connect on Linkedln: linkedin.com/in/mahalaxmi-g-46a391245** **For Opportunities visit: https://ibegin.tcs.com/iBegin** **Website: www.tcs.com**