Python,Pyspark,AWS

Job description

Roles and Responsibilities • Design, develop, test, deploy, and maintain large-scale data processing pipelines using AWS services such as S3, Lambda, Step Functions, etc. • Develop high-quality code in Python using PySpark for big data processing tasks. • Ensure scalability, reliability, and performance of deployed applications by monitoring logs, metrics, and other relevant KPIs. Desired Candidate Profile • 6-8 years of experience in backend development with expertise in AWS services (S3, Lambda). • Strong proficiency in Python programming language with hands-on experience working with PySpark for big data processing tasks. • Experience building scalable architectures on cloud platforms like AWS; knowledge of containerization using Docker is an added advantage.