Aws Data Engineer (Chennai/ Pune/ Bangalore/Indore)
Tata Consultancy Services · Bengaluru, Karnataka, India - Chennai, Tamil Nadu, India - Pune, Maharashtra, India
Tata Consultancy Services · Bengaluru, Karnataka, India - Chennai, Tamil Nadu, India - Pune, Maharashtra, India
**Key Responsibilities** - Design, develop, and maintain data pipelines and ETL workflows on AWS - Build and manage data ingestion pipelines from: - Databases - Files - APIs - Streaming systems (e.g., Kafka) - Develop transformation logic using PySpark / Apache Spark - Work with AWS services such as Glue, Lambda, S3, EC2, and Step Functions - Implement and maintain data models and data processing workflows - Optimize pipelines for performance, scalability, and cost efficiency - Ensure data quality, validation, and reliability across systems - Participate in code reviews and Agile development processes - Troubleshoot and resolve data pipeline issues **Must-Have Skills** - Strong experience in Data Engineering - Hands-on experience with: - ETL / Data Pipeline Development - Data Integration and Processing - PySpark / Apache Spark - Experience with AWS ecosystem: - AWS Glue - AWS Lambda - Amazon S3 / EC2 - AWS Step Functions - Strong knowledge of: - SQL (PostgreSQL, Redshift, or similar) - Data Modeling Concepts **Good-to-Have Skills** - Experience with streaming technologies (Kafka) - Exposure to other ETL tools (Informatica, Talend) - Experience working in Agile development environments - Strong communication and problem-solving skills