D

Technology & Transformation - Engineering - Senior Consultant - AWS Data Engineer

Deloitte · State of Karnataka, India

6–12 yrs experiencePosted 3w ago
Apply now →

Job description

Job requisition ID :: 106918 Date: Jun 23, 2026 Location: Bengaluru Designation: Senior Consultant Entity: Deloitte Touche Tohmatsu India LLP **Technology & Transformation - Engineering - Senior Consultant - AWS Data Engineer** - **Job requisition ID** : 106918 - **Location**: Hyderabad/Bengaluru - **Entity**: Deloitte Touche Tohmatsu India LPP. **Job Title: Software Engineer – Data Engineering** **Experience:** 6+ Years **Open Positions:** 15 **Location:** Bengaluru / Hyderabad **Work Model:** Hybrid – Mandatory 3 days/week from client office **About the Role** We are looking for skilled Data Engineers to join a high visibility datastore migration program. The selected candidates will be part of the **Datastore Migration Factory Team**, responsible for end-to-end migration from **on-prem Data Lake to AWS-hosted Lakehouse architecture**. This role involves pipeline migration, data transformation, reconciliation, and stakeholder engagement to ensure seamless migration and functional equivalence of production data assets. **Key Responsibilities** - Migrate data pipelines from legacy/on-prem Data Lake environments to **AWS-hosted Lakehouse** - Refactor and migrate extraction logic, scheduling workflows, and ingestion frameworks - Build and optimize **data ingestion pipelines** - Convert and optimize legacy **SQL/Spark-based consumption patterns** for **Snowflake and Iceberg** - Ensure **data integrity, reconciliation, and quality validation** during migration - Work closely with internal stakeholders for data handoff, sign-off, and migration validation - Collaborate with platform and data management teams to adopt new workflows and technologies - Analyze usage patterns to deliver optimized and scalable data products **Must Have Skills** - **6+ years of strong hands-on development experience** - Experience in **AWS Cloud** with **on-prem to Lakehouse migration** - Strong expertise in **building ingestion pipelines** - Strong proficiency in **SQL** and coding skills in **Python** - Strong understanding of: - **SCDs (Slowly Changing Dimensions)** - **Milestoning / Temporal Data Modeling** - **Data Lineage** - **Data Lake concepts** - **Schema Evolution & Enforcement** - **Data Partitioning & Clustering** - Experience with **Spark** - Familiarity with **CI/CD practices and SDLC** - Basic troubleshooting and scripting experience **Good to Have Skills** - Experience with **Kafka** - Exposure to **Hadoop (HDFS/Hive)** - Knowledge of **Sybase IQ** - Experience with **Kubernetes (K8s) deployments** - Familiarity with data formats such as **JSON, Avro, and Parquet** - Hands-on experience with **Snowflake** and **Apache Iceberg** - Understanding of **Normalization vs Denormalization**, **Natural vs Surrogate Keys** **Educational Qualification** Bachelor’s or master’s degree in computer science**, Engineering, Applied Mathematics**, or a related quantitative field. **Key Competencies** - Strong ownership and delivery mindset - Excellent stakeholder management and communication skills - Ability to work effectively with global teams across time zones - Strong problem-solving skills and learning agility - High integrity, collaboration, and professionalism