AI Tester

Date: 27 Feb 2025

Company: Qualitest Group

Country/Region: IN

Experience : 5 to 7 yrs Model Evaluation & Testing: Design and execute test cases to assess generative AI models for accuracy, relevance, bias, and robustness.• Prompt & Response Analysis: Develop structured prompts and analyze AI-generated outputs to ensure alignment with business and ethical guidelines.• Automation & Benchmarking: Implement automated testing frameworks using tools like Ragas, DeepEval, and LangTest to establish benchmark metrics and ensure model reliability.• Edge Case & Adversarial Testing: Identify and test edge cases, adversarial inputs, and failure scenarios to improve model robustness and safety.• Collaboration & Reporting: Work closely with AIML developers to report issues, recommend improvements, and refine model training and evaluation processes.