Data Engineer (ETL)
Allegis Group · Hyderabad, Telangana, India - Pune, Maharashtra, India
Allegis Group · Hyderabad, Telangana, India - Pune, Maharashtra, India
**Role & responsibilities** - Seeking a **Senior Data Engineer / ETL Engineer** with 5+ years of experience in designing, developing, and optimizing ETL pipelines and data integration solutions. - Strong expertise in **GCP services** including BigQuery, Dataflow (Apache Beam), Cloud Storage, Pub/Sub, and Cloud Composer/Airflow. - Experience with **DataStage, Control-M, SQL, Python, and cloud migration projects** to build scalable and reliable data workflows. - Hands-on knowledge of **Big Data technologies** such as Hadoop, Hive, Spark, Kafka, Flink, and batch/stream processing frameworks. - Responsible for data governance, automation, performance tuning, monitoring, and delivering high-quality data solutions for analytics and reporting. **Preferred candidate profile** : - 5+ years of experience as a **Data Engineer/ETL Developer** with strong expertise in **DataStage, ETL development, and data warehousing**. - Hands-on experience with **Google Cloud Platform (GCP)** including BigQuery, Dataflow (Apache Beam), Cloud Storage, Pub/Sub, and Cloud Composer/Airflow. - Strong programming skills in **Python, SQL, and Java**, with experience building scalable batch and streaming data pipelines. - Exposure to **Big Data technologies** such as Hadoop, Hive, Spark, Kafka, HBase, Flink, and MapReduce. - Proven experience in **cloud migration projects**, data integration, performance optimization, automation, and data governance/security best practices.