ETL Pyspark Testing

Virtusa · Bengaluru, Karnataka, India - Chennai, Tamil Nadu, India - Hyderabad, Telangana, India

~₹14L (est.)3–9 yrs experiencefull_timePosted 2w ago

Job description

**Roles and Responsibilities :** - Design, develop, test, deploy and maintain ETL processes using PySpark on AWS cloud platform. - Collaborate with cross-functional teams to identify business requirements and design data solutions that meet those needs. - Develop complex SQL queries to extract insights from large datasets stored in relational databases. - Troubleshoot issues related to ETL pipeline failures and optimize performance for improved efficiency. **Job Requirements :** - 6-9 years of experience in ETL Testing or similar field. - Strong proficiency in PySpark programming language and its applications in big data processing. - Experience working with AWS cloud platform including S3 buckets, Glue jobs, Lambda functions etc.