Databricks - Principal Data Engineer

Job description

**Core Responsibilities:** - Databricks Architecture — Design, optimize, and manage end‑to‑end data pipelines using Databricks (Spark, Delta Lake, Unity Catalog). - ETL/ELT Pipelines — Build scalable ingestion and transformation frameworks for structured and semi‑structured data. - Cloud Platforms — Implement solutions on Azure/AWS/GCP with strong understanding of compute, storage, and networking. - Data Warehouse Modernization — Lead migration from legacy systems to modern lakehouse architectures. - Team Leadership — Mentor engineers, conduct design reviews, and drive delivery excellence. - Customer Engagement — Lead technical discussions, requirement workshops, and solution walkthroughs. Required Skills Qualifications” - Databricks Expertise: Deep knowledge of Unity Catalog, Photon engine, Databricks SQL, and optimization. - Cloud Infrastructure: Proven experience architecting scalable data solutions on Azure, AWS, or GCP. - Data Warehousing: Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning. - Soft Skills: Exceptional analytical thinking, stakeholder management, and clear technical articulation. - Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, DevOps. - Experience with large‑scale DWH, performance tuning, and data modeling. - Proven ability to lead multi‑team delivery in enterprise environments. - Total Experience: 12 years - Relevant Experience: 7 years in Databricks and cloud data engineering - Location: Hybrid - Employment Type: Full-time