Job Description

We are seeking AI-focused QA professionals who can help define how AI applications should be tested, evaluated and continuously improved.

This opportunity is ideal for professionals who combine strong QA fundamentals, automation expertise and hands-on AI/LLM evaluation experience.

CORE REQUIREMENTS

8-12 years of overall QA/Testing experience
Hands-on experience testing AI/LLM/GenAI applications
Strong Manual and Automation Testing experience
Web, API and Mobile testing expertise
Evaluate AI outputs for accuracy, relevance, consistency, hallucinations, bias and safety
Design AI-focused test strategies and test datasets
Build or implement AI evaluation frameworks
Strong Python and API automation experience
Experience with Postman, BrowserStack/TestMu AI or equivalent tools
Understanding of Prompt Engineering and AI behavior
Strong exploratory testing and root-cause analysis skills
Agile development experience
Ability to work closely with Product, Engineering and AI/ML teams
Strong ownership and stakeholder management skills
Healthcare domain experience is a plus.

AI evaluation experience, ownership, problem-solving and a strong quality mindset.

We are not looking for someone who only executes test cases. We need professionals who can challenge AI behavior, identify AI-specific risks, improve QA processes and contribute to overall quality strategy.