JobScans.in

Job description

Role: Data Engineer Skill : Data Engineering, Bigquery,ETL Pipelines Experience: 7 to 12 years Job Description: Key Responsibilities - Design, develop, and optimize data pipelines using Google BigQuery - Execute and support Teradata to BigQuery migration projects - Develop and manage data ingestion using BigQuery Data Transfer Service (BQ DTS) - Build and maintain ETL/ELT pipelines using Python - Automate workflows using Cloud Composer (Apache Airflow) - Deploy scalable data processing services using Cloud Run - Manage data storage in Google Cloud Storage (GCS) - Ensure data quality, governance, and performance tuning - Collaborate with cross-functional teams - Monitor and troubleshoot data workflows Required Skills - Strong experience with Google BigQuery - Hands-on with BigQuery Data Transfer Service (BQ DTS) - Experience in Teradata to BigQuery migration - Proficiency in Python - Experience with Cloud Composer (Airflow) - Knowledge of Cloud Run - Experience with Google Cloud Storage (GCS) - Strong SQL skills - Experience in automation Good to Have - CI/CD pipelines in GCP - Knowledge of Dataflow / Pub-Sub - Terraform or Infrastructure as Code - Data modeling and warehousing concepts Educational Qualification Bachelors/Masters degree in Computer Science, IT, or related field Key Competencies - Problem-solving skills - Ability to work in fast-paced environments Good communication skills