GCP BigQuery Developer

Job description

Educational Requirements Bachelor of Engineering Service Line Data Analytics Unit Responsibilities - Design, develop, and optimize BigQuery-based data warehouses and data marts - Build and maintain ETL/ELT pipelines using GCP services - Write efficient, complex SQL queries for data transformation and analysis - Work with Cloud Composer (Airflow), Dataflow, or Dataproc for pipeline orchestration - Perform data modelling (star/snowflake schema) for analytics use cases - Optimize query performance and manage BigQuery cost efficiency - Integrate data from various sources (APIs, Cloud Storage, databases, streaming sources) - Implement data validation, quality checks, and monitoring mechanisms - Collaborate with data analysts, data scientists, and business stakeholders - Ensure security and governance best practices within GCP Additional Responsibilities: - Experience with CI/CD tools (Cloud Build, Jenkins, GitHub Actions) - Knowledge of data visualization tools (Looker, Tableau, Power BI) - Familiarity with streaming data pipelines (Pub/Sub) - Experience with Infrastructure as Code (Terraform) - Understanding of data governance and access control in GCP - Bachelors degree in Computer Science, IT, or related field - GCP certifications (e.g., Professional Data Engineer) are a plus Technical and Professional Requirements: - Strong experience with Google BigQuery - Advanced proficiency in SQL - Hands-on experience with GCP services: BigQuery, Cloud Storage, Dataflow / Dataproc, Cloud Composer (Airflow) - Experience in ETL/ELT pipeline development - Good understanding of data warehousing concepts - Familiarity with Python or PySpark for data processing - Experience in performance tuning and query optimization - Knowledge of data partitioning and clustering in BigQuery Preferred Skills: - Technology->Cloud Platform->GCP Database