Job Title: AI Test Engineer
Duration: Fulltime
Location: Pune/ Kharadi
Job Summary:
We are looking for a detail-oriented and analytical AI Tester to ensure the quality and reliability of our AI models and systems.
The ideal candidate will have experience in testing AI/ML applications, a strong understanding of machine learning concepts, and expertise in designing test cases for complex AI systems.
You will play a critical role in identifying issues, ensuring compliance with ethical AI standards, and improving the overall performance of AI solutions.
Key Responsibilities:
1.
Test Planning and Strategy:
- Develop comprehensive test plans and strategies for AI/ML models and systems.
- Define testing methodologies, including functional, performance, and stress testing for AI applications.
2.
Test Case Design and Execution:
- Design and execute test cases to validate AI models, algorithms, and workflows.
- Test AI systems for accuracy, bias, fairness, and robustness.
- Simulate real-world scenarios to evaluate the performance of AI models.
3.
Defect Identification and Reporting:
- Identify, document, and report issues, bugs, and inconsistencies in AI systems.
- Work closely with data scientists and engineers to resolve defects and improve model performance.
4.
Performance Monitoring:
- Monitor the performance of AI models in production environments.
- Validate model outputs against expected results and business requirements.
5.
Compliance and Ethical Testing:
- Ensure AI systems comply with ethical AI principles, data privacy regulations, and organizational standards.
- Test for unintended biases and ensure fairness in AI decision-making processes.
6.
Automation and Tools:
- Develop and maintain automated testing frameworks for AI/ML systems.
- Use testing tools and frameworks (e.G., Selenium, PyTest, or custom tools) to streamline testing processes.
7.
Collaboration:
- Collaborate with data scientists, AI engineers, and product teams to understand requirements and testing needs.
- Provide feedback and recommendations to improve AI model quality and reliability.
8.
Documentation:
- Document test cases, results, and processes for future reference.
- Prepare detailed reports on testing outcomes and areas for improvement.
Qualifications:
Education:
- · Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related field.
- Experience:
- · 3+ years of experience in software testing, with at least 1-2 years focused on AI/ML systems.
- · Hands-on experience with testing AI models, algorithms, and workflows.
- · Familiarity with machine learning concepts, frameworks (e.G., TensorFlow, PyTorch), and data pipelines.
- Skills:
- · Strong understanding of testing methodologies and tools.
- · Proficiency in programming languages like Python or Java for test automation.
- · Knowledge of data validation, model evaluation metrics, and performance testing.
- · Familiarity with cloud platforms (e.G., AWS, Azure, Google Cloud) is a plus.
- · Strong analytical and problem-solving skills.
- Certifications (Optional):
- · ISTQB or other software testing certifications.
- · AI/ML-related certifications are a plus.
Key Competencies:
- · Attention to detail and a commitment to quality.
- · Strong communication and collaboration skills.
- · Ability to work in a fast-paced, dynamic environment.
- · Passion for ensuring the reliability and fairness of AI systems.