Snowflake with Azure Data Engineer-Pan India

Job description

Desired Competencies (Technical/Behavioral Competency) Must-Have • Proficient in SQL programming (stored procedures, user defined functions, CTEs, window functions), Design and implement Snowflake data warehousing solutions, including data modelling and schema designing Snowflake • Able to source data from APIs, data lake, on premise systems to Snowflake. • Must have minimum 2 yrs experience in AWS Glue • Process semi structured data using Snowflake specific features like variant, lateral flatten • Experience in using Snow pipe to load micro batch data. • Experience in Snowpark using python. • Good knowledge of caching layers, micro partitions, clustering keys, clustering depth, materialized views, scale in/out vs scale up/down of warehouses. • Hands-on in creating reusable pipelines for handling SCD type1, type2 loads. • Ability to implement data pipelines to handle data retention, data redaction use cases. • Proficient in designing and implementing complex data models, ETL processes, and data governance frameworks. • Strong hands on in migration projects to Snowflake • Deep understanding of cloud-based data platforms and data integration techniques. • Skilled in writing efficient SQL queries and optimizing database performance. • Ability to development and implementation of a real-time data streaming solution using Snowflake Good-to-Have • Good knowledge of caching layers, micro partitions, clustering keys, clustering depth, materialized views, scale in/out vs scale up/down of warehouses SN Role descriptions / Expectations from the Role 1 Analysis of business requirements 2 Involve in daily scrum calls and retrospection. 3 Involve in development of code using Snowflake , MS SQL according to the requirements. 4 Involve in Unit Testing and Bug fixing during testing phase.