Tata Consultancy Services · Bengaluru, Karnataka, India - Delhi, Delhi, India - Hyderabad, Telangana, India - San Carlos, Rio San Juan, Nicaragua
Azure Data Engineer(Python, PySpark, Databricks, ADF) The successful candidate will be responsible for - Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python. - Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. - Manage efficiently large dataset. - Manage SQL database - Postgresql or MongoDB. - Implement and maintain complex data calculation formula. - Open to collaborate with Software Engineers. - Participate in code reviews, design discussions, and software planning. - Contribute to automation, testing, and deployment processes. - Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python. - Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine. - Manage effeciently large dataset. - Manage SQL database - Postgresql or MongoDB. - Implement and maintain complex data calculation formula. - Open to collaborate with Software Engineers. - Participate in code reviews, design discussions, and software planning. - Contribute to automation, testing, and deployment processes.