• Expertini Resume Scoring: Our Semantic Matching Algorithm evaluates your CV/Résumé before you apply for this job role.
India Jobs Expertini

Generative AI Test Automation Engineer Job Opening In India, India – Now Hiring BharatGen


Job description

Job Summary:

We are looking for an AI Evaluation & Test Engineer to join our growing team to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user experience.

You will serve as the first customer of our AI systems.

This role is ideal for product-minded engineers who obsess over product quality and customer-centricity, and are passionate about shaping the behavior of AI systems in the real world.


Key Responsibilities:

  • Build and maintain AI evaluation pipelines to test, measure, and evaluate the behavior and performance of AI systems.
  • Implement traces, spans, and session tracking for observability and identify error propagation in multi-step pipelines.
  • Define AI quality metrics and KPIs around factuality, faithfulness, toxicity, grounding precision/recall, latency, cost, etc., with clear acceptance bars.
  • Implement evaluation and testing automation to enable end-to-end system and regression testing at scale.
  • Define criteria for and implement release gates in the CI/CD pipeline.
  • Find creative ways to break products.
  • Assist in root cause analysis and troubleshooting of bugs and field issues.
  • Collaborate with cross-functional teammates from product, engineering, linguistics, and customer support to shape human-AI interaction paradigms and ensure that our AI models and applications deliver the desired outcome and user experience.


Minimum Qualifications and Experience:

  • Bachelor’s or Master’s degree in CS/CE/IT/EE/E&TC or related fields with 5+ years of experience in manual and automation testing of software products, with at least 2 years in evaluating and testing AI/ML products.


Required Expertise:

  • Strong software testing fundamentals and expertise in writing test plans, executing test cases, and generating detailed reports and dashboards.
  • Strong analytical and debugging skills, and attention to detail.
  • Proficiency in Python, scripting, and software testing automation frameworks and tools such as Pytest, Selenium, Robot Framework, etc.
  • Working knowledge of generative AI models, AI agents, and related concepts such as retrieval augmented generation (RAG), prompt engineering, context engineering, explainability, traceability, observability, guard rails, reasoning, specificity, etc.
  • Sound understanding of the fundamental differences in the approach for testing conventional software versus evaluating generative AI systems.
  • Team player with excellent interpersonal skills and the ability to collaborate effectively with remote and cross-functional team members.
  • Go-getter attitude and ability to flourish in a fast-paced, startup environment.
  • Experience in any of the following would be a big plus -

- AI evaluation frameworks such as Arize, Braintrust, DeepEval, LangSmith, Ragas

- AI safety and red teaming experience, e.G., prompt injection, jailbreak, adversarial and stress testing.

- Different types of AI evaluation methods, e.G, Human-in-the-loop, LLM-as-a-Judge.

Required Skill Profession

Computer Occupations


  • Job Details

Related Jobs

Teradata hiring AI Test Automation Engineer Job in Hyderabad, India, India
Teradata
Hyderabad, India, India
Daybreak hiring Senior AI Test Automation Engineer Job in Bengaluru, Karnataka, India
Daybreak
Bengaluru, Karnataka, India
Teradata hiring Senior AI Test Automation Engineer Job in Hyderabad, India, India
Teradata
Hyderabad, India, India
ValueMomentum hiring AI Test Automation Architect Job in Hyderabad, Telangana, India
ValueMomentum
Hyderabad, Telangana, India
Bristlecone hiring Generative AI Engineer Job in Dindigul, Tamil Nadu, India
Bristlecone
Dindigul, Tamil Nadu, India
VDart Digital hiring Generative AI Engineer Job in Belgaum, Karnataka, India
VDart Digital
Belgaum, Karnataka, India
Utkast AI hiring Generative AI Engineer Job in India
Utkast AI
India
Utkast AI hiring Generative AI Engineer Job in Meerut, Uttar Pradesh, India
Utkast AI
Meerut, Uttar Pradesh, India
Bristlecone hiring Generative AI Engineer Job in Kolkata, West Bengal, India
Bristlecone
Kolkata, West Bengal, India
Utkast AI hiring Generative AI Engineer Job in Dindigul, Tamil Nadu, India
Utkast AI
Dindigul, Tamil Nadu, India
Utkast AI hiring Generative AI Engineer Job in Kollam, Kerala, India
Utkast AI
Kollam, Kerala, India
VDart Digital hiring Generative AI Engineer Job in Alappuzha, Kerala, India
VDart Digital
Alappuzha, Kerala, India
Utkast AI hiring Generative AI Engineer Job in Kozhikode, Kerala, India
Utkast AI
Kozhikode, Kerala, India
Utkast AI hiring Generative AI Engineer Job in Udaipur, Rajasthan, India
Utkast AI
Udaipur, Rajasthan, India
Utkast AI hiring Generative AI Engineer Job in Vellore, Tamil Nadu, India
Utkast AI
Vellore, Tamil Nadu, India
Utkast AI hiring Generative AI Engineer Job in Nashik, Maharashtra, India
Utkast AI
Nashik, Maharashtra, India
VDart Digital hiring Generative AI Engineer Job in Solapur, Maharashtra, India
VDart Digital
Solapur, Maharashtra, India
Bristlecone hiring Generative AI Engineer Job in Kollam, Kerala, India
Bristlecone
Kollam, Kerala, India
VDart Digital hiring Generative AI Engineer Job in Bengaluru, Karnataka, India
VDart Digital
Bengaluru, Karnataka, India
Utkast AI hiring Generative AI Engineer Job in Mysuru, Karnataka, India
Utkast AI
Mysuru, Karnataka, India
Bristlecone hiring Generative AI Engineer Job in Nagpur, Maharashtra, India
Bristlecone
Nagpur, Maharashtra, India
Utkast AI hiring Generative AI Engineer Job in Eluru, Andhra Pradesh, India
Utkast AI
Eluru, Andhra Pradesh, India
Utkast AI hiring Generative AI Engineer Job in Coimbatore, Tamil Nadu, India
Utkast AI
Coimbatore, Tamil Nadu, India
Bristlecone hiring Generative AI Engineer Job in Bengaluru, Karnataka, India
Bristlecone
Bengaluru, Karnataka, India
VDart Digital hiring Generative AI Engineer Job in Kochi, Kerala, India
VDart Digital
Kochi, Kerala, India
Utkast AI hiring Generative AI Engineer Job in Davangere, Karnataka, India
Utkast AI
Davangere, Karnataka, India
Utkast AI hiring Generative AI Engineer Job in Rajahmundry, Andhra Pradesh, India
Utkast AI
Rajahmundry, Andhra Pradesh, India
Utkast AI hiring Generative AI Engineer Job in Jaipur, Rajasthan, India
Utkast AI
Jaipur, Rajasthan, India
Utkast AI hiring Generative AI Engineer Job in Nellore, Andhra Pradesh, India
Utkast AI
Nellore, Andhra Pradesh, India
VDart Digital hiring Generative AI Engineer Job in Coimbatore, Tamil Nadu, India
VDart Digital
Coimbatore, Tamil Nadu, India

Unlock Your Generative AI Potential: Insight & Career Growth Guide


Real-time Generative AI Jobs Trends (Graphical Representation)

Explore profound insights with Expertini's real-time, in-depth analysis, showcased through the graph here. Uncover the dynamic job market trends for Generative AI in India, India, highlighting market share and opportunities for professionals in Generative AI roles.

104467 Jobs in India
104467
6400 Jobs in India
6400
Download Generative Ai Jobs Trends in India and India

Are You Looking for Generative AI Test Automation Engineer Job?

Great news! is currently hiring and seeking a Generative AI Test Automation Engineer to join their team. Feel free to download the job details.

Wait no longer! Are you also interested in exploring similar jobs? Search now: .

The Work Culture

An organization's rules and standards set how people should be treated in the office and how different situations should be handled. The work culture at BharatGen adheres to the cultural norms as outlined by Expertini.

The fundamental ethical values are:

1. Independence

2. Loyalty

3. Impartiapty

4. Integrity

5. Accountabipty

6. Respect for human rights

7. Obeying India laws and regulations

What Is the Average Salary Range for Generative AI Test Automation Engineer Positions?

The average salary range for a varies, but the pay scale is rated "Standard" in India. Salary levels may vary depending on your industry, experience, and skills. It's essential to research and negotiate effectively. We advise reading the full job specification before proceeding with the application to understand the salary package.

What Are the Key Qualifications for Generative AI Test Automation Engineer?

Key qualifications for Generative AI Test Automation Engineer typically include Computer Occupations and a list of qualifications and expertise as mentioned in the job specification. The generic skills are mostly outlined by the . Be sure to check the specific job listing for detailed requirements and qualifications.

How Can I Improve My Chances of Getting Hired for Generative AI Test Automation Engineer?

To improve your chances of getting hired for Generative AI Test Automation Engineer, consider enhancing your skills. Check your CV/Résumé Score with our free Tool. We have an in-built Resume Scoring tool that gives you the matching score for each job based on your CV/Résumé once it is uploaded. This can help you align your CV/Résumé according to the job requirements and enhance your skills if needed.

Interview Tips for Generative AI Test Automation Engineer Job Success

BharatGen interview tips for Generative AI Test Automation Engineer

Here are some tips to help you prepare for and ace your Generative AI Test Automation Engineer job interview:

Before the Interview:

Research: Learn about the BharatGen's mission, values, products, and the specific job requirements and get further information about

Other Openings

Practice: Prepare answers to common interview questions and rehearse using the STAR method (Situation, Task, Action, Result) to showcase your skills and experiences.

Dress Professionally: Choose attire appropriate for the company culture.

Prepare Questions: Show your interest by having thoughtful questions for the interviewer.

Plan Your Commute: Allow ample time to arrive on time and avoid feeling rushed.

During the Interview:

Be Punctual: Arrive on time to demonstrate professionalism and respect.

Make a Great First Impression: Greet the interviewer with a handshake, smile, and eye contact.

Confidence and Enthusiasm: Project a positive attitude and show your genuine interest in the opportunity.

Answer Thoughtfully: Listen carefully, take a moment to formulate clear and concise responses. Highlight relevant skills and experiences using the STAR method.

Ask Prepared Questions: Demonstrate curiosity and engagement with the role and company.

Follow Up: Send a thank-you email to the interviewer within 24 hours.

Additional Tips:

Be Yourself: Let your personality shine through while maintaining professionalism.

Be Honest: Don't exaggerate your skills or experience.

Be Positive: Focus on your strengths and accomplishments.

Body Language: Maintain good posture, avoid fidgeting, and make eye contact.

Turn Off Phone: Avoid distractions during the interview.

Final Thought:

To prepare for your Generative AI Test Automation Engineer interview at BharatGen, research the company, understand the job requirements, and practice common interview questions.

Highlight your leadership skills, achievements, and strategic thinking abilities. Be prepared to discuss your experience with HR, including your approach to meeting targets as a team player. Additionally, review the BharatGen's products or services and be prepared to discuss how you can contribute to their success.

By following these tips, you can increase your chances of making a positive impression and landing the job!

How to Set Up Job Alerts for Generative AI Test Automation Engineer Positions

Setting up job alerts for Generative AI Test Automation Engineer is easy with India Jobs Expertini. Simply visit our job alerts page here, enter your preferred job title and location, and choose how often you want to receive notifications. You'll get the latest job openings sent directly to your email for FREE!