Business Intelli Solutions - Artificial Intelligence Tester

<p><p><b>Job Title :</b> AI Tester<br/><br/><b>Work Location & Reporting Address : </b>Bangalore, Hyderabad, Chennai, Trivandrum, Pune, Noida, Gurgaon, Chandigarh<br/><br/><b>Contract duration (in months) : </b>6 Months</p><p><br/><b>Skill Set</b> : AI Tester<br/><br/><b>Job Description : </b><br/><br/>- Understand Design and implementation of AI models using Large Language Models (LLMs) with a focus on OpenAI or Azure OpenAI or LangSmith technologies.<br/><br/>- Test multi-agent workflows and agentic frameworks to facilitate collaboration among AI agents.<br/><br/>- Utilize effective prompting techniques to enhance the performance of AI modelTESTs and ensure optimal outputs.<br/><br/>- Implement Retrieval-Augmented Generation (RAG) techniques and manage vector databases to improve information retrieval processes.<br/><br/>- Testing agent tools integration using Model Context Protocol (MCP) for seamless communication and operation of AI agents.<br/><br/>- Monitor and analyze system performance through observation and telemetry to improve AI model accuracy and reliability.<br/><br/>- Collaborate with cross-functional teams to test RESTful APIs that support AI functionalities and integrations.<br/><br/>- Ensure the security of AI applications by testing implementations of security fundamentals, including OAuth2.x authentication methods.<br/><br/>- Testing SQL databases (SQL Server preferred) to ensure data integrity and accessibility.<br/><br/>- Write efficient code in Python and TypeScript, adhering to best practices and coding standards.<br/><br/>- Optionally, utilize C# for certain application components testing as needed.<br/><br/><b>Mandatory Skills :</b></p><p><br/></p><p>- Proven experience working with Large Language Models (LLMs), with specific experience in OpenAI or Azure OpenAI or LangChain preferred.<br/><br/>- Strong understanding of agentic frameworks and multiagent systems.<br/><br/>- Expertise in effective prompting strategies for AI models.<br/><br/>- Familiarity with Retrieval Augmented Generation (RAG) and vector databases.<br/><br/>- Experience with agent tools, particularly Model Context Protocol (MCP).<br/><br/>- Proficient in monitoring and telemetry techniques for AI applications.<br/><br/>- Strong programming skills in Python and TypeScript experience with C# is a plus.<br/><br/>- Knowledge of REST API fundamentals and best practices.<br/><br/>- Understanding of security fundamentals, including OAuth2.x and secure coding practices.<br/><br/>- Experience with SQL databases, specifically SQL Server, is highly desirable.<br/><br/>- Strong problem-solving skills, with a focus on delivering high quality software solutions.<br/><br/>- Excellent communication and teamwork skills, with the ability to collaborate effectively across departments.<br/><br/><b>Good to Have Skills :</b></p><p><br/></p><p>- TFS, GitHub tool knowledge<br/><br/>- FrameWork Design<br/><br/>- Along with technical skills, need Good Communication and articulation skills</p><br/></p> (ref:hirist.tech)