Azure Databricks Engineer

Job description

Job Description- Years of Experience: 5-7 years Share your resume over Aarushi.Shukla@Coforge.Com (Only if you can join in September) with following information- • Current & Preferred Location- • Current & Expected CTC- • Notice Period & Probable DOJ- Job Summary: We are seeking a highly skilled Senior Data Engineer with a strong background in cloud-based data solutions. The ideal candidate will have extensive experience with Azure DevOps, Snowflake, and Azure Data Factory, and must possess expertise in Azure Databricks. This role involves designing, developing, and maintaining data pipelines and architectures to support our data-driven initiatives. Responsibilities: Design, develop, and implement data pipelines using Azure Data Factory and Snowflake. Utilize Azure Databricks for data processing and analytics, ensuring high performance and scalability. Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. Monitor and optimize data workflows and processes for efficiency and reliability. Implement CI/CD practices using Azure DevOps to streamline deployment processes. Ensure data quality and integrity through rigorous testing and validation processes. Document data architecture, processes, and workflows for future reference and compliance. Stay updated with the latest industry trends and technologies to continuously improve data solutions. Mandatory Skills: • Azure DevOps • Snowflake • Azure Data Factory • Azure Databricks (Deal Breaker Skill)