MS Fabric Sr. Engineer

Job description

Key Responsibilities Data Engineering Development - Build and maintain data ingestion pipelines using Data Factory, Dataflows Gen2, Pipelines, and event driven patterns. - Develop Lakehouse structures using Delta Lake, Notebooks (PySpark), and medallion architecture. - Implement Fabric Data Warehouse objects (tables, stored procedures, views, SQL endpoints). - Create and optimize semantic models for Power BI, including Direct Lake datasets. - Develop KQL databases and real time analytics components where required. Operational Delivery - Implement CI/CD pipelines for Fabric using Git integration and DevOps best practices. - Monitor, troubleshoot, and optimize Fabric workloads for performance and cost. - Ensure data quality through validation rules, profiling, and automated checks. - Support production deployments, incident resolution, and environment management. Collaboration Stakeholder Support - Work with Hiscox business teams to understand data requirements and translate them into technical solutions. - Collaborate with Solution Architects to ensure alignment with overall platform design. - Provide technical guidance to analysts, report developers, and data consumers. Governance, Security Compliance - Apply data governance standards using Purview integration, lineage, and metadata management. - Implement access controls, workspace security, and data protection policies. - Ensure compliance with insurance regulatory requirements (e.g., GDPR, Solvency II, IFRS 17). Continuous Improvement - Contribute to reusable frameworks, templates, and accelerators for Fabric engineering. - Stay updated with new Fabric features and recommend adoption where beneficial. - Participate in code reviews, design sessions, and engineering best practice forums. \\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_ Required Skills Experience Technical Expertise - 6–10 years of experience in data engineering, with strong Azure analytics background. - Hands on experience with Microsoft Fabric, including: o Data Engineering (Lakehouse, Notebooks, Pipelines) o Data Factory (Dataflows Gen2, Pipelines) o Data Warehouse (SQL Endpoint, Direct Lake) o Power BI (datasets, DAX, semantic models) o OneLake Delta Lake - Strong skills in SQL, PySpark, Python, and ETL/ELT development. - Experience with Azure services such as ADLS, ADF, Databricks, Synapse, Event Hub, and Key Vault. Domain Knowledge - Experience working with insurance data (policies, claims, pricing, exposure, risk) is highly desirable. - Understanding of regulatory reporting (Solvency II, IFRS 17) is a plus. Soft Skills - Strong problem solving and analytical skills. - Ability to work in agile, cross functional teams. - Clear communication and documentation abilities. - Able to guide junior team members. \\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_ Nice-to-Have - Microsoft Fabric or Azure Data Engineer certifications. - Experience migrating from Synapse/Databricks to Fabric. - Familiarity with Lloyd’s market data structures. \\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_\\_ Engagement Details - Location: Hybrid/Remote with occasional visits to Hiscox offices (London, York, or other locations as required). - Reporting: Works under the MS Fabric Solution Architect and collaborates with Hiscox Data Platform teams. - Duration: Multi phase program aligned with Hiscox’s data modernization roadmap.