Data Engineer - Snowflake , Datstage/Pyspark - 15 May - Virtual Interv

Job description

Role: Snowflake & PySpark/DataStage Developer Experience: 48 years Location: Hyderabad **Role Summary** We are seeking a skilled Snowflake & PySpark/DataStage Developer with 4–5 years of experience to design, develop, and maintain scalable data pipelines and ETL solutions. The role involves working across Snowflake data warehouse and ETL platforms such as PySpark and/or IBM DataStage to deliver high-quality data solutions for analytics and reporting. **Key Responsibilities** - Design, develop, and maintain ETL pipelines using PySpark and/or IBM DataStage. - Develop and optimize data models, tables, views, and transformations in Snowflake. - Perform data ingestion, transformation, and loading from multiple source systems into Snowflake. - Implement performance tuning, optimization, and best practices for Snowflake and ETL jobs. - Ensure data quality through validations, reconciliations, and error-handling mechanisms. - Write and optimize SQL queries for data transformation and analytical use cases. - Prepare and maintain technical documentation including ETL mappings, LLDs, and data flow diagrams. - Support SIT/UAT and production issues, enhancements, and minor change requests. **Required Skills & Experience** - 4–5 years of hands-on experience in ETL / Data Engineering roles. - Strong experience with Snowflake (data modeling, SQL, performance tuning). - Hands-on experience with PySpark for large-scale data processing OR IBM DataStage ETL development. - Strong SQL skills for querying, transformation, and validation. - Good understanding of data warehousing concepts (fact/dimension tables, star schema). - Experience with UNIX/Linux and basic shell scripting. - Familiarity with version control tools such as Git and Agile delivery methodologies.