Hiring For GCP Data Engineer For PAN India

Job description

Hi, We are hiring for GCP Data Engineer for PAN India. Interested candidates please share your updated resume on deepawaliprab.maski@hcltech.com with below details: Job Location: Bangalore/Chennai/Noida/Pune Total & Relevant Experience: Current CTC & Expected CTC: Current Location & Preferred Location Notice Period: **Experience looking for :** 4-15+ Years **Job Summary** We are seeking a skilled **GCP Data Engineer** to design, develop, and maintain scalable data pipelines and data processing solutions on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with **Dataflow, BigQuery, Dataproc**, and cloud-based data engineering practices. The candidate will be responsible for building robust ETL/ELT pipelines, optimizing data workflows, and enabling analytics and reporting solutions. **Key Responsibilities** - Design, develop, and maintain scalable batch and real-time data pipelines on GCP. - Build and optimize ETL/ELT solutions using **Google Cloud Dataflow (Apache Beam)**. - Develop and manage large-scale data warehouses using **BigQuery**. - Implement distributed data processing solutions using **Dataproc (Apache Spark/Hadoop)**. - Integrate data from multiple sources including databases, APIs, and cloud storage. - Perform data modeling, partitioning, clustering, and query optimization in BigQuery. - Ensure data quality, governance, security, and compliance standards are met. - Monitor, troubleshoot, and optimize data pipelines for performance and reliability. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. - Automate deployment and orchestration of data workflows using CI/CD practices. - Support production operations and resolve data-related issues. **Required Skills** **GCP Services** - Google Cloud Platform (GCP) - BigQuery - Dataflow - Dataproc - Cloud Storage (GCS) - Pub/Sub - Cloud Composer (Airflow) - Cloud Functions **Data Engineering** - ETL/ELT development - Data Warehousing concepts - Batch and Streaming Data Processing - Data Modeling - Data Quality and Governance **Programming** - Python (preferred) - SQL (advanced) - PySpark - Shell Scripting **Big Data Technologies** - Apache Spark - Hadoop Ecosystem - Apache Beam **Required Qualifications** - Bachelor's or Master's degree in Computer Science, Information Technology, or related field. - 4+ years of experience in Data Engineering. - 2+ years of hands-on experience with Google Cloud Platform. - Strong expertise in BigQuery query optimization and performance tuning. - Experience building scalable pipelines using Dataflow and Apache Beam. - Experience with Dataproc and Spark-based processing frameworks. - Strong SQL and Python programming skills. - Experience with source control systems such as Git. **Preferred Qualifications** - GCP Professional Data Engineer Certification. - Experience with Terraform or Infrastructure as Code (IaC). - Knowledge of Kafka or Pub/Sub messaging systems. - Experience working in Agile/Scrum environments. - Exposure to DevOps and CI/CD tools. **Nice to Have** - Experience with Looker, Tableau, or Power BI. - Knowledge of data governance and metadata management tools. - Experience with machine learning data pipelines on GCP. **Interview Must-Have Skills** - GCP Data Engineering - BigQuery - Dataflow (Apache Beam) - Dataproc (Spark) - Python - Advanced SQL - ETL/ELT Design - Data Warehousing **Keywords:** GCP, Google Cloud Platform, BigQuery, Dataflow, Dataproc, Apache Beam, Spark, PySpark, SQL, Python, ETL, ELT, Data Lake, Data Warehouse, Cloud Composer, Pub/Sub, GCS, Data Engineering.**Role & responsibilities** Hi, We are hiring for GCP Data Engineer for PAN India. Interested candidates please share your updated resume on deepawaliprab.maski@hcltech.com with below details: Job Location: Bangalore/Chennai/Noida/Pune Total & Relevant Experience: Current CTC & Expected CTC: Current Location & Preferred Location Notice Period: **Experience looking for :** 4-15+ Years **Job Summary** - Python - Advanced SQL - ETL/ELT Design - Data Warehousing **Keywords:** GCP, Google Cloud Platform, BigQuery, Dataflow, Dataproc, Apache Beam, Spark, PySpark, SQL, Python, ETL, ELT, Data Lake, Data Warehouse, Cloud Composer, Pub/Sub, GCS, Data Engineering. **Preferred candidate profile**