Aws Data Engineer

Job description

Roles and Responsibilities • Design, develop, and maintain large-scale data pipelines using AWS services such as S3, Glue, Lambda, Step Functions, etc. • Develop ETL processes using PySpark on AWS EMR clusters to extract insights from structured and unstructured data sources. • Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. • Ensure high availability and scalability of the data pipeline by implementing monitoring tools like CloudWatch and X-Ray. • Troubleshoot issues related to data processing, storage, and retrieval.