Wipro - Databricks Architect

Job description

**Location :** Bangalore **Shift :** 2 PM to 11.30 PM **Experience :** 8 - 14 yrs **NP :** Immediate to 45 Days only. **About the Position :** The Principal Data Platform Engineer is a member of the Data \& Analytics (D\&A) Platform and Architecture team responsible for the design, development, testing, maintenance, and support of CSC's Enterprise Data Platform. Working on a dedicated scrum team, the Principal Data Platform Engineer will provide technical and architectural design, as well as development and analytical support for CSC's D\&A platform. The Principal Data Platform Engineer must have demonstrable big data experience with cloud computing in order to help the D\&A team deliver high-quality, first-class reporting to customers. A skillset that includes data architecture and system design is a must. **Your Responsibilities :** - Driving technical vision and architecture for the enterprise data platform, collaborating closely with HQ architects and engineering leads. - Lead the design, development, and maintenance of scalable data platforms using Databricks, Data Lake, Data Factory, and Data Warehouse. - Defining and implementing integration patterns across ingestion, transformation, and consumption layers. - Architect and implement advanced CI/CD pipelines using GitHub and Terraform. - Identifying performance bottlenecks and leading query and pipeline optimization. **Required :** - 8 years of experience in data engineering or data platform roles, with at least 5 years designing and building big data systems in a cloud environment (Azure preferred). - Deep expertise in Python, automated testing, Github actions related to infrastructure development. - Hands-on experience with Databricks, including Delta Lake, Unity Catalog, and medallion architecture patterns. - Experience with Azure Data Factory or comparable orchestration tooling. - In-depth knowledge of Azure Key Vault and security best practices. - Experience with Unity Catalog and managing multiple workspaces. - Experience with CI/CD design and infrastructure-as-code practices (Terraform or equivalent). **Preferred :** - Experience with enterprise data governance tools (Collibra or equivalent). - Exposure to enterprise scheduling/orchestration platforms (e.g., Tidal). - Familiarity with Power BI or comparable BI platforms at the platform/infrastructure layer.