AI Test Engineer (QA)
Role Summary
The AI Test Engineer ensures quality, reliability, safety, and correctness of AI enabled systems across the SDLC.
Key Responsibilities
- Design and execute test strategies for GenAI and Agentic AI apps
- Validate LLM outputs for:
- Accuracy
- Bias
- Hallucinations
- Safety
- Test prompt versions and AI behavior changes
- Automate functional and non functional tests
- Test AI integrations, APIs, and workflows
- Perform regression testing for AI model/version changes
- Collaborate with developers on quality gates
Required Skills
- Application testing (manual + automation)
- Test automation frameworks (Selenium, Playwright)
- API testing
- CI/CD quality gates
AI Specific Skills
- Testing LLM outputs and prompt behavior
- Understanding of model variability and non determinism
- Test data management for AI
- Knowledge of responsible AI testing concepts
Experience
- 5–8 years in software testing
- Hands on GenAI / AI testing experience required
