ETL Developer with AWS exp

Job description

**Role- ETL developer** **Exp- 6+yrs** **Location Greater Noida, Pune** **Role Summary** **We are looking for a skilled** **ETL Developer** **with strong experience in** **AWS-based data engineering solutions, including** **AWS Glue, Lambda, and ETL pipelines. The candidate will be responsible for designing, developing, and maintaining scalable and high-performing data pipelines to support business analytics and operational reporting.** **This role requires a good understanding of data transformation, workflow orchestration, and cloud-based data processing.** **Key Responsibilities** - **Design, develop, and maintain** **ETL pipelines** **using AWS services** - **Build and manage** **AWS Glue jobs** **for data extraction, transformation, and loading** - **Develop and deploy** **AWS Lambda functions** **for automation and event-driven processing** - **Integrate data from multiple sources (databases, APIs, files, etc.)** - **Ensure** **data quality, integrity, and consistency** **across pipelines** - **Optimize performance of ETL jobs and troubleshoot bottlenecks** - **Work with large datasets and ensure efficient data processing** - **Collaborate with** **data analysts, business teams, and architects** **to understand requirements** - **Implement logging, monitoring, and error handling mechanisms** - **Participate in** **production support, issue resolution, and RCA** - **Maintain proper documentation for ETL workflows and data pipelines** **Must Have Skills & Experience** **Technical Skills** - **Strong experience in** **ETL development** **(6+ years)** - **Hands-on experience with:** - **AWS Glue (ETL jobs, crawlers)** - **AWS Lambda (Python-based functions preferred)** - **Strong knowledge of** **SQL and data transformation techniques** - **Experience with** **data warehousing concepts** - **Good understanding of** **cloud architecture (AWS)** - **Experience working with** **large-scale data processing** - **Familiarity with** **event-driven architecture** - **Strong debugging and performance tuning skills** **Tools & Technologies** - **AWS Services:** - **Glue, Lambda, S3** - **(Nice if: Step Functions, Redshift)** - **Programming:** - **Python (preferred)** - **Databases:** - **Relational & cloud-based** **Nice to Have** - **Experience with** **AWS Step Functions (workflow orchestration)** - **Exposure to** **Redshift / data warehousing solutions** - **Knowledge of** **CI/CD pipelines and DevOps practices** - **Experience with** **data streaming (Kafka / Kinesis)** - **Familiarity with** **BI tools (Power BI / Tableau)** - **Domain experience in** **Insurance (P&C / Lloyds)** **is a plus**