Gcp Data Engineer

Job description

- 5+ years of experience We are seeking a skilled GCP Data Engineer to support the modernization of legacy data warehouse and ETL systems into a scalable and cloud-native architecture on Google Cloud Platform (GCP). The role involves designing, developing, and maintaining data pipelines for migration, ensuring data accuracy, performance, and operational reliability. Responsibilities: - Design, develop, and implement ETL/ELT pipelines on GCP using BigQuery, Cloud Composer (Airflow), Dataflow, and Cloud Storage. - Analyze and convert Teradata SQL and BTEQ batch scripts into BigQuery queries and Python-based GCP pipelines. - Build and maintain batch processing workflows aligned with modern cloud-native best practices. - Develop orchestration workflows in Cloud Composer to replace legacy Control-M schedules. - Perform data migration activities including ingestion, transformation, and loading into BigQuery. - Execute unit testing, data validation, reconciliation, and support System Integration Testing (SIT). - Optimize BigQuery queries and pipelines for performance, scalability, and cost efficiency. - Develop pipeline, troubleshoot failures, and ensure production stability. - Collaborate with data architects, leads, SMEs, and DevOps teams to ensure successful delivery. - Support architecture reviews, assessments, risk mitigation planning, and technical governance throughout the migration lifecycle. - Document pipeline logic, transformation rules, and operational procedures for maintainability.