Data Engineer

Job description

Skill: GCP Data Analytics/GCP Data Engineer Experience: 7 to 10 years Location: Gurgaon / Noida / Hyderabad Mode: Hybrid Job Description: Data Pipeline Development • Design and build robust ETL/ELT pipelines for batch and stream processing using GCP tools. Data Warehousing & Modeling • Build and optimize data models, data lakes, and data warehouses, primarily using BigQuery for analytical workloads. Workflow Orchestration • Automate, schedule, and monitor data workflows using orchestration frameworks. Pipeline Optimization • Enhance system performance and manage resource allocation for cost-efficiency. Data Governance & Security • Enforce data quality frameworks, lineage tracking, security protocols, and compliance standards. Cross-Functional Collaboration • Partner with DevOps, Software Engineering, and Business Intelligence teams to deploy data solutions into production environments. Essential Qualifications & Skills Cloud Services • Proficiency with GCP ecosystem services such as: • BigQuery • Cloud Dataflow • Cloud Storage • Cloud Composer • Apache Airflow • Dataform/dbt • Pub/Sub Programming • Advanced expertise in SQL and Python/Java. Big Data Frameworks • Hands-on experience with distributed computing and processing frameworks, e.g., Apache Spark, PySpark, or Apache Beam. Data Engineering Concepts • Solid understanding of: • Data Warehousing • Star/Snowflake Schemas • Dimensional Modeling • Change Data Capture (CDC) DevOps Practices • Familiarity with: • CI/CD pipelines • Git version control • Infrastructure as Code (e.g., Terraform)