Data Engineer

Job description

Job Title- Data Engineer Position type- Full Time Work Location- Bangalore Working style- Hybrid People Manager role: No Required education and certifications critical for the role- Any Graduate or Post-Graduate (full time) Required years of experience – Minimum 4+ years of relevant experience About The Role The Data Engineer will contribute to the Altair modernization program by developing and maintaining data pipelines on Azure and Databricks. You will work on building scalable data solutions that support reinsurance analytics, Property & Casualty loss ratio calculations, and workflow automation. As an individual contributor, you will collaborate with Senior Data Engineers, Solution Architects, Business Analysts, and domain SMEs to deliver reliable data assets. This role offers an excellent opportunity to work on a large-scale modernization initiative, gain exposure to the reinsurance domain, and develop expertise in modern cloud data platforms and AI-enabled solutions. Aon is in the business of better decisions At Aon, we shape decisions for the better to protect and enrich the lives of people around the world. As an organization, we are united through trust as one inclusive team and we are passionate about helping our colleagues and clients succeed. What The Day Will Look Like Data Pipeline Development • Develop and maintain data ingestion, transformation, and integration pipelines on Databricks using PySpark • Build ETL/ELT workflows to process structured and unstructured data from multiple upstream systems • Implement data transformations following established design patterns and best practices • Support data imports using Unity Catalog and agreed ingestion patterns • Contribute to the development of data flows for the Altair modernization program Data Quality & Governance • Implement data quality checks, validation processes, and error handling in data pipelines • Support data governance, security, lineage, and compliance standards • Develop and maintain data models and schemas for reinsurance business processes • Ensure data accuracy and reliability for downstream analytics and reporting Business Requirements & Collaboration • Work with Business Analysts and SMEs to understand reinsurance business requirements • Translate moderately complex business requirements into technical data solutions • Collaborate with Product Owners, Project Managers, and QA Engineers to deliver data assets • Participate in requirement gathering sessions and provide technical input Technical Development & Best Practices • Write clean, maintainable, and well-documented code following team standards • Participate in code reviews and incorporate feedback to improve code quality • Contribute to the development of reusable components and data engineering patterns • Create technical documentation and operational procedures for data pipelines Support & Optimization • Monitor data pipeline performance and reliability • Troubleshoot data issues and implement fixes in collaboration with senior team members • Support production data pipelines and respond to operational issues • Identify opportunities for pipeline optimization and performance improvement Learning & Knowledge Transfer • Participate in knowledge transfer sessions with external vendors and senior team members • Learn about reinsurance domain concepts, business processes, and analytics requirements • Stay updated on Azure, Databricks, and data engineering best practices • Contribute to building in-house capabilities and reducing vendor dependency About The Project You will be joining the RAPID team focused on the Altair modernization program. The team is building a modern, Azure-based version of Workflow Studio that integrates multiple applications and enables end-to-end process custody from data intake through client deliverables in the reinsurance domain. The program involves decomposing existing Altair capabilities and re-implementing them across three core layers: Databricks (data architecture layer), Workflow Studio (process custody layer), and Blueprint/Remetrica (visualization and analytics layer). You will work with a collaborative team including Solution Architects, Product Owners, Project Managers, Senior Data Engineers, QA Engineers, and reinsurance SMEs. Existing projects in the ecosystem include Workflow Studio, Blueprint, Remetrica, and Altair manual processes. This role offers excellent growth opportunities and exposure to modern cloud technologies, AI-enabled solutions, and the reinsurance domain. What You'll Gain • Hands-on experience with modern cloud data platforms (Azure, Databricks, PySpark) • Exposure to large-scale modernization and migration programs • Understanding of reinsurance domain and Property & Casualty analytics • Opportunity to work with AI-enabled data solutions and emerging technologies • Collaboration with experienced engineers, architects, and domain experts • Career growth path in data engineering and cloud technologies Required Qualifications Skills and experience that will lead to success Education & Experience • Bachelor's degree in Engineering, Computer Science, Data Engineering, Information Systems, or related field • 4+ years of experience in data engineering, software engineering, or big data development • Experience developing ETL/ELT pipelines and working with large-scale datasets Technical Skills • Solid proficiency in Python for data processing and engineering • Strong expertise in SQL for data manipulation and analysis • Experience with PySpark or willingness to learn and work with distributed data processing • Knowledge of Databricks or similar cloud data platforms • Understanding of Azure data services or other cloud platforms (AWS, GCP) • Experience with ETL/ELT workflows and data integration • Understanding of data modeling and data qual