<p><p><b>Role Overview :</b><br/><br/>We are seeking a highly skilled Gen AI Tester to design and execute test strategies that ensure the quality, reliability, and accuracy of AI-driven applications, including chatbots, agents, and generative AI tools.
This role demands strong expertise in both manual and automated testing, with a focus on validating AI outputs against business requirements and expected behavior.<br/><br/><b>Key Responsibilities :</b><br/><br/>Comprehensive Test Strategy Development :<br/><br/></p><p>- Design, document, and execute detailed test plans and scenarios for AI chatbots, agents, and tools, ensuring rigorous validation of outputs against defined business rules and AI behavior.<br/><br/>- Automated Test Scripting :<br/><br/></p><p>- Develop, maintain, and enhance automated test scripts using Python, JavaScript, or Bash to streamline and scale testing across AI functionalities.<br/><br/>Defect Identification & Documentation :<br/><br/></p><p>- Proactively identify, log, and track issues within AI models and applications.
Provide clear and actionable bug reports with reproducible steps, expected vs.
actual outcomes, and severity assessment.<br/><br/>Cross-functional Collaboration :<br/><br/></p><p>- Partner with development, product, and data science teams to align on requirements, validate fixes, and provide feedback across the AI development lifecycle.<br/><br/>Continuous Improvement :<br/><br/></p><p>- Stay updated on emerging tools, techniques, and trends in AI testing and automation.
Recommend and implement process improvements to enhance product quality and testing efficiency.<br/><br/>Performance & Scalability Testing (Optional) :<br/><br/></p><p>- Conduct load, stress, and scalability testing on AI models to validate system performance under diverse conditions and user loads.<br/><br/><b>Skills & Qualifications :</b><br/><br/>- Proven AI Testing Experience: Hands-on experience in testing AI-driven applications, conversational AI platforms, or generative AI tools.<br/><br/>- Proficient in Scripting & Automation: Strong coding skills in Python, JavaScript, or Bash for test automation.<br/><br/>- Analytical Acumen: Ability to interpret complex technical/business requirements and design effective test scenarios.<br/><br/>- Testing Expertise: Solid knowledge of manual and automated testing methodologies, including regression, integration, functional, and UAT.<br/><br/>- Proactive & Independent: Self-starter with strong ownership, capable of independently identifying testing needs and driving solutions.<br/><br/>- Communication Skills: Excellent verbal and written communication, with the ability to provide precise documentation and articulate findings to stakeholders.</p><br/></p> (ref:hirist.tech)