Gcp Data Engineer-Immediate Joiner-Bangalore

Job description

Key Responsibilities and Accountabilities: We are seeking a skilled Data Engineer with 35 years of experience to join our team. He/she will be responsible for designing, building, and optimizing data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. His/her work will ensure data reliability, scalability, and quality, supporting the organizations analytics and operational needs. • Design, develop, and maintain robust and scalable data pipelines using GCP services, including BigQuery, Cloud Storage, Dataform, Cloud Run Functions and Workflows. • Implement and manage infrastructure as code using Terraform for automated provisioning and management of data infrastructure. • Optimize performance of data warehouses and pipelines through partitioning, clustering, and other best practices to ensure efficient data processing and query performance. • Monitor and maintain the health of the data infrastructure, proactively identifying and resolving issues to ensure high data reliability and uptime. • Troubleshoot and resolve data-related issues, ensuring data quality and consistency across systems. • Collaborate with data analysts, data scientists, and other engineers to understand data requirements and deliver high quality data solutions. • Ensure data reliability, scalability, and quality through robust validation, testing, and monitoring processes. • Manage version control and code collaboration using Git. • Develop and maintain API integrations for data ingestion and delivery. • Document technical solutions and maintain up-to-date records of data workflows and infrastructure. 3. Key qualifications • 3–5 years of professional experience as a Data Engineer or in a similar data-focused role. • Strong analytical and problem-solving skills. • Excellent communication and collaboration abilities. 3. Preferred skills • Experience with CI/CD pipelines for data engineering workflows. • Familiarity with data governance and obser