Senior Data Engineer
S&P Global · Hyderabad, Telangana
S&P Global · Hyderabad, Telangana
About the Role: Grade Level (for internal use): 10The Team: Step into a dynamic team at the cutting edge of data innovation! You’ll collaborate daily with talented professionals from around the world, designing and developing next-generation data products for our clients. Our team thrives on a diverse toolkit that evolves with emerging technologies, offering you the chance to work in a vibrant, global environment that fosters creativity and teamwork. Responsibilities & Impact: • Architect and develop scalable Bigdata and cloud applications, harnessing a range of cloud services to create robust, high-performing solutions. • Design and implement advanced CI/CD pipelines, automating software delivery for fast, reliable deployments that keep us ahead of the curve. • Tackle complex challenges head-on, troubleshooting and resolving issues to ensure our products run flawlessly for clients. • Lead by example, providing technical guidance and mentoring to your team, driving innovation and embracing new processes. • Deliver top-tier code and detailed system design documents, setting the standard with technical walkthroughs that inspire excellence. • Bridge the gap between technical and non-technical stakeholders, turning complex requirements into elegant, actionable solutions. • Mentor junior developers, nurturing their growth and helping them build skills and careers under your leadership. What We’re Looking For: We’re seeking a passionate and experienced professional who brings: • 5 -7 years of expertise in designing and building data-intensive solutions using distributed computing, with a proven track record of scalable architecture design. • 4+ years of hands-on experience with Python, PySpark/Hadoop, and data/workflow orchestration tools, demonstrating technical versatility. • Proficiency in SQL, NoSQL, Apache Spark, Airflow, or similar tools, with deep experience operationalizing data pipelines for large-scale batch and stream processing. • Extensive experience deploying data engineering solutions in public cloud environments like GCP or AWS , leveraging cloud capabilities to their fullest potential. • A strong history of collaborating with business stakeholders and users to shape research directions and deliver robust, maintainable products. • A talent for rapid prototyping and iteration, delivering high-quality solutions under tight deadlines. • Exceptional communication and documentation skills, with the ability to explain complex ideas to both technical and non-technical audiences. • Good to have skills: • Strong knowledge of Gen AI tools (e.g., GitHub Copilot, ChatGPT, Claude, or Gemini) and their power to boost developer productivity. • Advanced programming skills in Java or Scala, supported by a portfolio of impactful projects • Expertise in containerization, scripting and CI/CD practices, ready to shine in a modern development ecosystem. What’s In It For You? Our Mission: Advancing Essential Intelligence. Our People: We're more than 35,000 strong worldwide—so we're able to understand nuan