AI Engineer

Job Description:Testing of GenAI infused AI Chatbot application.

Roles and Responsibilities: Understand the capabilities of AI chatbot to come up with testing strategiesTesting of independent AI Agents for their specific tasksSetting prompts for testing RAG pipeline and Agents

Understanding various actions for adversarial attacks, negative and edge case scenariosAutomate testing using Python based scripts to integrate with Chatbot APIsEvaluate Chatbot responses manually and automatically using DeepEval/RAGASTesting for Chatbot UI functionalities

Manage communication with stakeholders

Required Skills: Must Have: AI Tester with 5 to 8 years of experience

Good understanding of testing process in generalPython programming experience

Experience in data cleaning/preparing using Python/PandasKnowledge in GenAI, Prompt engineering and related python libraries for integrating the use of Gen AI models from OpenAI and AWS bedrockUnderstanding of NLP

Good to Have:Exposure to DeepEval / RAGASUnderstanding of AWS Bedrock

3 must havesGen AI 4/5AWS 3/5Python 3/5