Xtrackers SEA - Voyager - AVP, Data Engineer

Job description

**Job Title: Xtrackers SEA - Voyager - AVP, Data Engineer** **Location: Bangalore, India** **Role Description** We are seeking an experienced Data Engineer at AVP level to design, build, and optimize scalable data pipelines and data models on Snowflake. This role requires strong expertise in data modelling, ETL architecture, and multi-database environments (SQL Server, Oracle, PostgreSQL). The candidate will play a key role in defining data structures, ensuring data quality, and enabling reliable data consumption across systems, while leveraging AI tools to enhance productivity. **AI-Assisted Engineering (Primary Focus)** Actively leverage AI-powered tools (GitHub Copilot, Gemini, etc. ) for: - Writing optimized SQL and transformation logic - Designing ETL pipelines and improving performance - Accelerating debugging, RCA, and documentation - Automating repetitive development and validation tasks - Ensure validation of AI-generated outputs for correctness, data integrity, and performance - Identify opportunities to use AI for improving data engineering workflows and productivity **Your key responsibilities** - Design, develop, and optimize ETL pipelines using Snowflake for large-scale data processing - Build robust data ingestion frameworks from multiple upstream systems - Ensure high data quality, consistency, and availability across downstream consumers - Perform root cause analysis (RCA) for complex data and pipeline issues - Lead production support for critical data pipelines and ensure system stability - Collaborate with business teams to understand data requirements and translate them into scalable solutions - Work closely with architects and senior engineers to align data solutions with enterprise architecture **Data Modelling (Core Focus Area)** - Design and implement dimensional data models (star schema, snowflake schema) - Work with fact and dimension tables for analytical and reporting use cases - Implement Slowly Changing Dimensions (SCD) for historical data tracking - Define data models for different layers (staging, curated, consumption) - Ensure data models are scalable, reusable, and aligned with business use cases - Optimize schema design for performance and efficient querying in Snowflake - Collaborate with stakeholders to evolve data models based on changing business requirements **Data Engineering and Processing** - Design complex data transformations and large-scale batch processing pipelines - Handle incremental and full data loads efficiently - Optimize Snowflake usage (compute, storage, query performance) - Implement best practices for data partitioning, clustering, and efficient querying - Handle structured and semi-structured data where applicable **Data Quality and Governance** - Define and implement data validation, reconciliation, and quality checks - Ensure data lineage, traceability, and auditability across pipelines - Identify and resolve data inconsistencies across systems - Follow enterprise data governance and compliance standards **Integration and Microservices** - Integrate data pipelines with microservices and API-based systems - Enable data exposure for real-time and batch consumption - Collaborate with backend teams for data exchange patterns **Cloud and Platform Awareness** - Work on Snowflake-based data platforms with good understanding of cloud concepts - Exposure to GCP services for data ingestion and orchestration (nice to have) - Ensure pipelines are scalable and cloud-native **Monitoring and Performance Optimization** - Monitor ETL pipelines and data processes for failures and performance issues - Identify and fix performance bottlenecks in queries and transformations - Implement alerting and monitoring for proactive issue detection **SDLC, Release and Compliance** - Drive deployment, validation, and release of data pipelines - Ensure compliance with SDLC processes and audit requirements - Document pipelines, data models, and transformation logic **Your skills and experience** - Strong SQL expertise (advanced queries, performance tuning, optimization) - Hands-on experience with Snowflake for ETL and data modelling - Strong experience with relational databases (SQL Server, Oracle, PostgreSQL) - Solid understanding of data modelling concepts (star schema, SCD, dimensional modelling) - Experience working with ETL pipelines and data integration patterns - Exposure to microservices and API-based integration - Familiarity with version control (Git) and CI/CD processes - Awareness of cloud platforms (GCP preferred) **Problem Solving and Ownership** - Strong analytical and problem-solving skills across data domains - Ability to handle complex data issues independently Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.