Know ATS Score
CV/Résumé Score
  • Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role: Senior AI QA Test Analyst.
India Jobs Expertini

Urgent! Senior AI QA Test Analyst Job Opening In Bengaluru – Now Hiring Nasdaq

Senior AI QA Test Analyst



Job description

Your role

and responsibilities:

We are seeking a highly skilled Test Automation Specialist to join our AI product development team.

The ideal candidate will have expertise in designing and implementing automated testing frameworks for sophisticated AI and machine learning systems.

 Furthermore, you will: 

  • Develop and maintain comprehensive automated test suites for generative AI models, including language models,and multimodal systems
  • Create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content
  • Design and implement automation frameworks to test generative AI products across multiple platforms and use cases
  • Collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems
  •  Develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios
  • Implement automated tests for prompt engineering, fine-tuning processes, and model versioning
  • Continuously improve testing methodologies to keep pace with constantly evolving generative AI technologies
  • Analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement
  • We expect you to have

  • Bachelor's or Master's degree in Computer Science, AI/ML, or related technical field
  • 2-4 years of experience in software test automation, with at least 2 years focused on AI/ML systems, preferably generative AI
  • Strong programming skills in Python.
  • Solid understanding of AI/ML algorithms and ability to validate their accuracy, bias, and performance.
  • Expertise in test automation tools and frameworks suitable for AI testing tools/frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework.
  • Experience in testing AI-driven applications, including data validation, model performance validation, and AI explainability.
  • Strong analytical and problem-solving skills, with a deep understanding of AI risks and mitigation strategies.
  • Solid experience in reviewing architectures, test strategies, and automation frameworks.
  • Knowledge of statistical analysis, probability, and mathematical modeling to validate AI systems.
  • Experience with AWS Bedrock, vectorized databases, and Sonnet/LLM algorithms.
  • Experience in performance testing of AI models and large-scale distributed systems.
  • It would be great if you

  • Experience with cloud platforms (AWS) for AI deployment and testing at scale
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes)
  • Knowledge of vector databases.
  • Does it sound like you?

    What happens now?

    As the selection process is ongoing, please submit your application in English as soon as possible.

    We will get back to you in 2-3 weeks.

    What will it be like working here?

    Nasdaq is a vibrant and entrepreneurial company where everyone is encouraged to take initiative, challenge status quo, and take intelligent risks.

    We want everyone to feel welcome and bring their authentic self to work.

    Every day, we are building a culture where we all feel connected, supported and empowered.

    We are a Hybrid-first environment that accepts work-life balance and fdevelopwell-being.

    Come as you are

    Nasdaq is an equal opportunity employer.

    We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information or any other status protected by applicable law.

    Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services.

    As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries.

    Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.

    To learn more, about our business visit business.nasdaq.com.

    Check out more about our Life at Nasdaq.

    Come as You Are

    Nasdaq is an equal opportunity employer.

    We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.

    We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

    Please contact us to request an accommodation.


    Required Skill Profession

    Computer Occupations



    Your Complete Job Search Toolkit

    ✨ Smart • Intelligent • Private • Secure

    Start Using Our Tools

    Join thousands of professionals who've advanced their careers with our platform

    Rate or Report This Job
    If you feel this job is inaccurate or spam kindly report to us using below form.
    Please Note: This is NOT a job application form.


      Unlock Your Senior AI Potential: Insight & Career Growth Guide