AI Testing

Job description

1. Job Title : Functional Specialist (ISG) 2. Job Summary : This role focuses on designing executing and optimizing testing strategies for artificial intelligence solutions in a hybrid work model for a large global organization. The Functional Specialist ensures high quality AI products by validating models data flows and user interactions while collaborating with cross functional teams to reduce defects mitigate risks and support safe and reliable deployment in a day shift setting. 3. Experience : 10 - 14 years 4. Required Skills : Technical Skills: AI Testing Domain Skills: 5. Nice to have skills : Domain Skills: 6. Technology : Custom Service 7. Shift : Day 8. Responsibilities : -Design comprehensive test strategies for artificial intelligence applications that validate model behavior data integrity and business functionality to ensure robust and reliable delivery across the organization. -Develop detailed test cases and reusable test assets for AI features covering functional testing regression testing integration testing and user journey validation to consistently reduce production defects. -Execute end to end test cycles for AI solutions using appropriate tools and frameworks while documenting outcomes anomalies and improvement opportunities to support continuous quality enhancement. -Analyze AI model outputs for accuracy consistency fairness and stability by applying structured evaluation methods and clearly reporting deviations that could impact users and business outcomes. -Collaborate closely with product managers data scientists engineers and business stakeholders to clarify requirements refine acceptance criteria and align test coverage with expected value realization. -Identify and document functional and nonfunctional risks specific to AI systems including performance bias and reliability concerns while proposing pragmatic mitigation actions for timely resolution. -Provide detailed defect reports with reproducible steps impact assessment and priority recommendations to help engineering teams address issues efficiently and improve overall system resilience. -Monitor test execution progress interpret quality metrics and prepare clear status updates and dashboards that enable informed decisions about readiness for release and deployment. -Contribute to the definition and refinement of AI testing methods templates and standards that can be adopted across projects to drive consistency and scalable quality practices in the enterprise. -Support user acceptance testing activities by preparing realistic scenarios guiding stakeholders through validations and consolidating feedback to ensure solutions meet practical usability expectations. -Document test results known limitations and residual risks in a structured manner so operational teams and business owners can understand quality posture before and after implementation. -Coordinate with support and operations teams during post release periods to validate fixes monitor AI behavior in production like environments and recommend corrective or preventive actions where needed. -Participate in knowledge sharing sessions and contribute to internal communities of practice so that insights from AI testing work can improve future designs and testing approaches across the company. -Qualifications -Possess extensive hands on experience in AI testing with ten to fourteen years in quality assurance or functional specialization roles focused on validating complex digital solutions. -Demonstrate strong understanding of artificial intelligence concepts such as model training evaluation and monitoring along with practical exposure to testing data driven and predictive systems. -Exhibit advanced skills in designing and executing functional regression and integration tests for AI based applications using modern test management tools and defect tracking platforms. -Apply solid analytical capabilities to interpret AI results metrics and logs and to distinguish between expected model behavior and genuine quality issues that require remediation. -Show proficiency in collaborating with cross functional teams including data science engineering and business stakeholders and in translating technical quality findings into clear business implications. -Utilize experience in working within hybrid work models and large multinational environments to manage priorities autonomously while maintaining effective communication across locations. -Bring familiarity with ethical considerations and regulatory expectations for AI solutions and apply this knowledge when defining test coverage for fairness transparency and user trust. Test Planning & Execution Develop and document comprehensive test cases and evidences for software releases outlining scope objectives and execution timelines. Define and standardize quality assurance processes including test case formats bug reporting workflows and testing methodologies. Testing of Agentic AI workflows is a plus. Test Automation Design and implement robust test automation frameworks (UI API performance and regression) using tools such as Selenium Cypress Playwright or similar. Maintain and enhance automation scripts to ensure high coverage and reliability across releases. Integrate automated tests into CI/CD pipelines (e.g. Azure DevOps Jenkins GitHub Actions) for continuous quality validation 9. Job Location : Primary Location :INTNCHNA10(ITIND MEPZ (TBM) SDB 1 -4 SEZ) Alternate Location :NA NA Alternate Location 1 :NA NA 10. Job Type : Functional Specialist (ISG) [50SG01] 11. Demand Requires Travel? : No 12. Certifications Required : Not Applicable