P99Soft - Senior Python Generative AI Tester - Automation Testing

<p><p><b>Job Title :</b> Sr. Python GenAi Tester<br/><br/><b>Experience :</b> 5+ Years<br/><br/><b>Location :</b> Hyderabad (Hybrid)<br/><br/><b>Job Summary :</b><br/><br/>- Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks and LangChain.<br/><br/></p><p>Key Requirements (8 Points) :<br/><br/></p><p> - Test LLM outputs on AWS Bedrock using boto3.<br/><br/></p><p> - Validate fine-tuned LLMs on AWS SageMaker with deepchecks.<br/><br/></p><p> - Verify langchain prompts in AWS environments.<br/><br/></p><p> - Test RAG pipelines with AWS OpenSearch and langchain.<br/><br/></p><p> - Validate AI agents (crewai/autogen) on AWS Lambda.<br/><br/></p><p> - Test n8n agentic workflows (e.g., n8n.io/workflows/6270).<br/><br/></p><p> - Ensure deployment stability on Amazon ECS/EKS with Docker.<br/><br/></p><p> - Monitor performance with Amazon CloudWatch and wandb.<br/><br/><b>Must-Have Skills :</b><br/><br/>- 5+ years of QA automation, 2 years testing GenAI/LLMs using Python<br/><br/></p><p>- Expertise in AWS Bedrock, SageMaker, Lambda, boto3.<br/><br/></p><p>- Proficiency in deepchecks, langchain, crewai, autogen, wandb.<br/><br/></p><p>- Experience testing n8n workflows, RAG, prompts.<br/><br/></p><p>Preferred Skills :<br/><br/></p><p> - AWS certification (Machine Learning/Solutions Architect).<br/><br/></p><p> - Familiarity with llama-index, n8n templates</p><br/></p> (ref:hirist.tech)