Databricks Architect

Job description

Experience : 15 - 18yrs Work mode : Hybrid Work location : Pune/Hyderabad/Bangalore/Chennai Notice Period : Imm - 45 days **Role: Senior Data Engineer / Data Architect (Azure)** - 10+ years of experience in **data discovery, data analysis, data quality, and data integration** - 7+ years of experience designing and building **real-time, near real-time, and batch data processing pipelines** - Strong experience in **data migration and cloud-based data warehousing**, primarily on **Microsoft Azure** - Ability to **analyze, debug, and enhance existing ETL pipelines** as well as design and develop new ones - Hands-on experience with **Azure Data Factory, Azure Databricks, Synapse Analytics**, and other Azure services - Expertise in **data ingestion, transformation, and orchestration workflows** - Good understanding of **data governance frameworks and tools** (e.g., Purview) - Proven experience in: - Designing **data architecture frameworks** - Troubleshooting performance issues in pipelines - Optimizing data processing solutions - Experience in building **metadata-driven data pipelines** - Strong knowledge of Azure ecosystem components: - **Data Lake** - **Databricks** - **Synapse** - **Purview** - Working knowledge of **Power BI** for reporting and data visualization - Programming experience in **Python / PySpark** (preferred) - Ability to write **high-performance, scalable, and maintainable code** - Strong **communication and stakeholder management skills**