Snowflake - Data Engineer

Job description

Role & responsibilities On a typical day, you might • Collaborate with the clients to understand the overall requirements • Create a robust, extensible architecture to meet the client/business requirements • Translate the Business requirements into technical artifacts • Identify the right technology stack and tools that best meet the client requirements • Design end to end solutions along with data strategy, including standards, principles, data sources, storage, pipelines, data flow, and data security policies • Collaborate with data engineers, data scientists, and other stakeholders to execute the data strategy • Perform data analysis to understand the relevant data sets • Design and create Data Models to cater to all the requirements • Identify and implement the right orchestration tool • Define the right security and access policies • Implement the Snowflake best practices • Define the right data distribution/consumption pattern for downstream systems and consumers • Perform the code reviews and ensure quality deliverables • Work with DevOps team to define and establish CI/CD process • Own end-to-end delivery of the project • Work closely with the clients during UAT Testing and ensure all client issues/concerns are addressed • Proactively identify the performance bottlenecks and propose corrective actions • Design and Develop reusable frameworks • Work with the Project Managers to prioritize work for each sprint to meet project milestones and deadlines • Closely monitor the Project progress and provide regular updates to the leadership teams on the milestones, impediments etc • Guide /mentor team members, and create the technical artifacts • Demonstrate thought leadership Preferred candidate profile • 4-9 years of relevant experience. • Work from our Chennai (white space) office all 5 days a week to handle sensitive data • Experience in Snowpro/ Python/ Pyspark • Decent experience in migration projects, migrating from  On-prem to Snowflake • Comprehensive knowledge of the Snowflake capabilities such as Snow pipe, SnowSQL, Streams, and Snowflake architecture and awareness of Snowflake roles and user security. • In-depth knowledge and experience in data migration from RDBMS to Snowflake cloud data warehouse • Well-versed with Incremental extraction loads - batched and streaming • Experience with Azure, AWS, or GCP • Ability to architect data architecture solutions that are in alignment with the strategic technology roadmap and emerging industry trends • Strong exposure to Data Modelling, Data Access Patterns, and SQL • Knowledge of  Cost Management, Infrastructure Planning & Disaster Recovery • Good experience in Data Governance and a good understanding of DevOps practices • Understanding of Data Virtualization • Experience in working in Big Data Platform • Ability to work closely with cross-functional teams • Excellent communication (verbal and written) and excellent interpersonal skills.