Gcp Data Engineer

Job description

Role Type: Full-time About the Role Highly experienced Lead Data Engineer with strong hands-on expertise in Google Cloud Platform (GCP), Dataflow, BigQuery SQL, and Python. In this role, you will lead end-to-end data engineering initiatives, drive architectural decisions, and mentor a team of engineers to build scalable, secure, high-performing data pipelines. Key Responsibilities • Architect, design, and develop scalable data processing pipelines on GCP (Dataflow, BigQuery, Pub/Sub, Cloud Storage). • Lead data ingestion, transformation, and integration initiatives across multiple business domains. • Optimize BigQuery workloads, SQL scripts, partitioning, clustering, and performance tuning. • Own end-to-end pipeline orchestration, monitoring, and operationalization. • Drive best practices around coding standards, CI/CD, governance, and documentation. • Collaborate with cross-functional teams including Data Science, Product, Architecture, and Analytics. • Mentor and guide a team of data engineers. Required Skills • Expert in GCP Dataflow, Apache Beam pipelines • Strong SQL skills, especially BigQuery SQL optimization • Solid Python programming with data frameworks • Experience with ETL/ELT frameworks and data warehousing • Strong understanding of distributed systems and data architecture • Experience in Agile environments