Senior GCP BQ Data Engineer

Job description

Educational Requirements Bachelor of Engineering,BTech,BCA,BSc,ME,MTech,MCA,MSc,MBA Service Line Data Analytics Unit Responsibilities - Design, develop, and maintain enterprise-scale data engineering solutions on Google Cloud Platform (GCP). - Build scalable ETL/ELT pipelines using Dataflow, Apache Beam, BigQuery, and Cloud Composer (Airflow). - Design and optimize BigQuery data warehouses for large-scale analytics and reporting. - Develop batch and real-time data pipelines using Dataflow and GCP-native services. - Implement workflow orchestration using Apache Airflow / Cloud Composer. - Design and manage data models and schemas in Cloud Spanner and BigQuery environments. - Integrate multiple data sources using GCP services such as Pub/Sub, Cloud Storage, Cloud Functions, and Dataflow. - Monitor, troubleshoot, and optimize pipeline performance, reliability, and scalability. - Collaborate with architects, business stakeholders, and development teams to deliver cloud data Technical and Professional Requirements: - 8 to 12 years of experience in Data Engineering, Big Data, and Cloud Data Platforms. - Strong hands-on experience with Google Cloud Platform (GCP). - Expertise in BigQuery for data warehousing, analytics, and performance optimization. - Strong experience with Dataflow and Apache Beam for large-scale data processing. - Experience with Apache Airflow and/or Cloud Composer for workflow orchestration. - Hands-on experience with Cloud Spanner and distributed database concepts. - Strong programming skills in Python and SQL. - Experience building enterprise-grade ETL/ELT pipelines. - Knowledge of Pub/Sub, Cloud Storage, Cloud Functions, and other GCP services. - Strong understanding of data modeling, performance tuning, and data integration. - Experience with version control systems such as Git. - Knowledge of CI/CD, DevOps practices, and Agile methodologies. Preferred Skills: - Technology->Big Data->Big Table->GCP - Technology->Cloud Platform->GCP Core Services