QA Tester AI & LLM Platforms

Job Description

We are looking for a QA Tester / QA Engineer with experience in AI, Generative AI, and LLM-based applications. The candidate should have strong knowledge of manual testing, AI model testing, API testing, performance testing, and automation.

Responsibilities

Perform functional, regression, smoke, sanity, integration, and exploratory testing.

Test AI chat and LLM-based applications across multiple AI models.

Validate AI-generated: Text, Images, Videos

Test model switching and verify correct model responses.

Validate conversation context and multi-turn interactions.

Test regeneration, retry, error handling, and model failure scenarios.

Validate AI response quality, accuracy, consistency, and relevance.

Test AI credits, usage limits, and consumption calculations.

Validate model-specific limits and rate limits.

Test AI response time and performance.

Verify handling of model timeouts, API failures, unavailable models, and unexpected responses.

Test different prompt types and edge cases.

Perform API testing using Postman.

Perform basic database validation using SQL.

Perform performance and load testing using JMeter or Locust.

Create and execute detailed AI/LLM test cases and test scenarios.

Identify, document, and track defects using JIRA.

Perform cross-browser and mobile testing.

Automate critical test scenarios using Playwright or Selenium.

Collaborate with developers, product managers, and QA engineers in an Agile environment.

Required Skills

Manual & Automation Testing

AI / Generative AI / LLM Testing

AI Chatbot Testing

Text, Image & Video Generation Testing

Multi-Model Testing

API Testing – Postman

SQL / Database Testing

Playwright / Selenium

JMeter / Locust

JIRA & Git

Good analytical and problem-solving skills

Preferred Experience

2–5 years of QA experience.

Experience testing AI/LLM, Generative AI, chatbot, or AI-powered platforms.

Understanding of AI model behavior, prompts, context handling, model switching, and response validation.

Experience testing text, image, and video generation workflows.

Experience with web and mobile application testing.