Data Analyst/Engineer (Collibra) - AWS

Tata Consultancy Services · Bengaluru, Karnataka, India - Chennai, Tamil Nadu, India - Kochi, Kerala, India

~₹14L (est.)3–8 yrs experiencefull_timePosted 1w ago

Job description

**Role -** Data Analyst/Engineer (collibra)-AWS **Desired Experience Range-** 6-12 Years **Location-** Chennai, Kochi, Trivandum, Bengaluru. **Job Description-** Responsible for building and maintaining data pipelines and transformation logic using PySpark/Databricks, enabling analytics and reporting use cases. **Roles & Responsibilities** - Develop ETL/ELT data pipelines using PySpark/Spark leveraging lakeflow declarative pipelines - Perform data transformation, cleansing, and enrichment - Optimize Spark jobs for performance and cost efficiency - Build datasets for analytics, reporting, and BI consumption - Leverage AWS query federation SDK/Databricks Datasource API for query federation - Work with multiple data sources (S3, APIs, etc.) 1 - Support data validation, reconciliation, and testing - Collaborate with architects, analysts, and downstream teams - Experience in Data transformation & pipeline development - Good to have experience in AWS Cloud ,AWS Databricks , Python , SQL, PySpark, Spark SQL ,Python , SQL,**Collibra**.