JobScans.in

Job description

TCS WALKIN FACE 2 FACE INTERVIEW on 25 JULY FOR THE BELOW SKILL SKILL : Azure Data Engineer( ADF/Databricks) LOCATION : Bangalore yashwantpur EXP : 5-15 YRS RELEVANT JD Skilled Azure Data Engineer with expertise in Azure Data Factory (ADF), Azure Databricks, and modern data engineering practices. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data integration solutions, and cloud-based data platforms on Microsoft Azure. Key Responsibilities - Design, develop, and implement ETL/ELT pipelines using **Azure Data Factory (ADF)**. - Build and optimize large-scale data processing solutions using **Azure Databricks (PySpark/Scala)**. - Develop data ingestion frameworks for structured, semi-structured, and unstructured data. - Create and maintain data lakes and data warehouses on Azure. - Integrate data from multiple sources such as SQL Server, Oracle, APIs, SAP, and cloud platforms. - Perform data transformation, cleansing, validation, and enrichment activities. - Monitor and troubleshoot data pipelines to ensure high availability and performance. - Implement data security, governance, and compliance standards. - Collaborate with business stakeholders, architects, and analytics teams to deliver data solutions. - Optimize Spark jobs and Databricks clusters for performance and cost efficiency. - Participate in CI/CD implementation using Azure DevOps. Required Skills Mandatory - Strong experience in **Azure Data Factory (ADF)**. - Hands-on experience with **Azure Databricks**. - Proficiency in **PySpark** and Spark SQL. - Experience with **Azure Data Lake Storage (ADLS Gen2)**. - Strong SQL development and query optimization skills. - Experience in ETL/ELT development and data warehousing concepts. - Knowledge of Azure ecosystem and cloud-native services. Good to Have - Azure Synapse Analytics. - Delta Lake and Medallion Architecture. - Azure DevOps and CI/CD pipelines. - Power BI integration. - Data modeling and dimensional modeling. - Scala or Python programming.