Urgent-AI/ML Test Engineer-Python, AWS/Azure -6+ Years must- Bangalore

Job description

Job Description: **Job Title *Lead*** Software Engineer This role, as part of the WI QA group, will be critical in supporting development of our capabilities relative to automation and AI/LLM application testing, including: supporting execution of our automation road map, working with team members to develop infrastructure and tools required across multiple technology stacks, working within guidelines and offering suggestions relative to governance procedures and overall development standards for AI-driven applications. **The Purpose of This Role** The primary objective of the WI QA team is to enable the WI business in the US, while working with IT business partners in a well-integrated way. Our team has developed technical expertise on various functions within each business line of Workplace investments, across strategic new products and within data engineering. We strive to achieve technical excellence in each of these functions and help the business accomplish its long-term objectives. This role focuses on the development of Automation Infrastructure in support of business needs, the technology evolution and ensuring the quality and reliability of AI/LLM-based applications. The position will be instrumental in developing and implementing cutting-edge testing strategies for AI-driven solutions, contributing to the overall innovation and efficiency of our technology stack. **The Value You Deliver** - Translate business and systems requirements into technical requirements for automation and software tools & framework. - Design, develop, document, and maintain automated tests and software tools for traditional and AI-driven applications. - Develop test strategies and methodologies specific to AI/LLM applications, including prompt following, output validation, and bias detection. - Adhere to software engineering principles in development of automation software and develop software to test both traditional and AI-powered software. - Understand and apply test driven/behavior driven design concepts to test and debug automated solutions and software utilities developed by self and others. - Actively contribute to the day-to-day planning, design, execution, and reporting of automation metrics and KPI's. - Deliver accurate and maintainable code for automated test suites and software utilities, including those for AI/LLM application testing. - Collaborate with other technical resources to: - Suggest improvements for processes, best practices, and standards in AI/LLM testing. - Identify opportunities to improve maintainability of automation platforms and AI testing frameworks. **The Skills that are Key to this role** **Technical / Behavioral** - Strong understanding of software development process including analysis, design, coding, system and user testing, problem resolution, and planning. - You should have good analytical skills and high aptitude to learn and adapt to new processes. - Proficiency in Python and good understanding of behavior driven development and automated testing. - You should be able to effectively debug and test own automation code, software code. - You should have good written and verbal communication and presentation skills. - You should possess organizational skills including time, project and process management. - Ability to work effectively with both business customers and project team members. - Good interpersonal, relationship management and facilitation skills. **The must have Skills for this role** - The following development experience is a strong plus: - Python - DB testing – SQL - ETL/ELT Testing - Experience with AI/LLM platforms such as OpenAI GPT, Claude Sonnet, or similar. - Familiarity with AI ethics and bias detection in AI systems. - Working knowledge of the following will be an advantage - Web Services Testing - Snowflake - Airflow - AWS