Digital : Google Data Engineering

Job description

We are seeking a highly skilled **Google Data Engineer (E4 level)** to design, build, and optimize scalable data solutions on the Google Cloud Platform (GCP). The ideal candidate should have strong expertise in **Big Data technologies and BigQuery**, with hands-on experience in data pipeline development, data modeling, and performance optimization. **Key Responsibilities** - Design, develop, and maintain scalable **data pipelines** using GCP services. - Build and manage **data warehouses using BigQuery**. - Develop and optimize **ETL/ELT workflows** for large-scale datasets. - Work with structured and unstructured data in **Big Data environments**. - Ensure **data quality, integrity, and governance** across pipelines. - Optimize queries and datasets for **performance and cost efficiency** in BigQuery. - Integrate data from multiple sources (APIs, databases, streaming systems). - Implement **real-time and batch data processing solutions**. - Collaborate with data scientists, analysts, and business stakeholders to deliver actionable insights. - Monitor and troubleshoot production data pipelines. **Required Skills & Expertise** - Strong experience in **Google BigQuery** - Data modeling, partitioning & clustering - Query optimization and cost management - Hands-on with **Big Data ecosystems** - Hadoop / Spark / Hive (preferably Spark on GCP Dataproc) - Expertise in **ETL/ELT pipeline development** - Proficiency in **SQL (advanced level)** **GCP Ecosystem** - Hands-on experience with: - **Cloud Storage** - **Dataflow (Apache Beam)** - **Dataproc** - **Pub/Sub (streaming pipelines)** - **Cloud Composer (Airflow)** - **BigLake / Data Catalog (nice to have)** **Programming** - Strong coding skills in: - **Python (preferred)** - Java/Scala (optional but good to have) **Data Engineering Concepts** - Data warehousing & dimensional modeling - Schema design (star/snowflake) - Data partitioning, clustering - Batch and streaming architecture - Data security & governance **Good to Have Skills** - Experience with **CI/CD pipelines** for data workflows - Knowledge of **Terraform / Infrastructure as Code** - Exposure to **Looker / Data Studio / BI tools** - Experience in **ML data pipelines on GCP** - Understanding of **Data Mesh / Modern Data Architecture** **Experience Requirements** - Typically **5+ years** of experience in Data Engineering - Minimum **23 years of hands-on experience in GCP** - Proven experience working with **BigQuery in production environments** **Education** - Bachelor’s or Master’s degree in Computer Science, Engineering, or related field **Soft Skills** - Strong analytical and problem-solving abilities - Excellent communication and collaboration skills - Ability to work in agile environments