Senior Data Engineer (Microsoft Fabric & Azure Data Platform)

Job description

Job Description We are seeking a Senior Data Engineer with 6-10 years of experience in building scalable cloud data solutions using Microsoft Fabric, Azure, Spark, SQL, and Python. Key Responsibilities • Design and develop ETL/ELT pipelines using Microsoft Fabric Data Factory, Spark, and SQL. • Build and maintain Lakehouse and Data Warehouse solutions in Fabric. • Develop batch and streaming data pipelines using Kafka/Event Hub. • Implement data modeling, transformation, and data quality processes. • Optimize pipeline performance, scalability, and cost efficiency. • Support data governance initiatives using Microsoft Purview. • Implement CI/CD, Git integration, and DataOps best practices. • Collaborate with architects, analysts, and business stakeholders to deliver data solutions. Required Skills • Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, OneLake) • SQL, Python, Spark/PySpark • Azure Data Factory, Synapse, or Databricks • Delta Lake, Data Warehousing, ETL/ELT • Kafka/Event Hub, APIs, JSON, Parquet • CI/CD, Git, DataOps