Quality Assurance Engineer

Location: Urban Vault HSR Layout, Bangalore

Experience: 2+ years

Employment Type: Full-time | On-site

About the Role

We are looking for a QA/QC Engineer to test and ensure the reliability of AI-powered systems that support real-world business operations across functions such as sales, HR, finance, and content.

The role involves testing AI systems that can make decisions and perform actions, requiring a strong focus on edge cases, hallucinations, prompt injections, inconsistent outputs, and AI-specific failure modes. This is an opportunity for a detail-oriented QA professional to build expertise in testing modern AI and LLM-based applications.

Key Responsibilities

• Design and execute manual test cases for AI-powered applications and workflows.
• Identify edge cases, unexpected behaviour, hallucinations, and failure scenarios in AI systems.
• Test AI agents for accuracy, reliability, consistency, and robustness.
• Perform functional, regression, exploratory, and scenario-based testing.
• Test conversational interfaces, prompts, and AI-generated responses.
• Identify potential prompt injection and misuse scenarios.
• Document defects clearly with actionable reproduction steps and expected vs. actual results.
• Collaborate with product and engineering teams to investigate, reproduce, and resolve issues.
• Continuously develop test scenarios by asking what if and challenging system behaviour.

Required Skills

• 2+ years of experience in QA/QC or software testing.
• Strong understanding of manual testing and test case design.
• Excellent attention to detail and ability to identify issues others may overlook.
• Hands-on experience using ChatGPT, Claude, or similar AI tools.
• Strong analytical and problem-solving skills.
• Clear written communication and ability to create effective bug reports.
• Curious, investigative mindset with a strong focus on quality.

Good to Have

• Experience with API testing using Postman or REST clients.
• Basic automation experience using Selenium, Cypress, or Python.
• Exposure to AI/ML, LLM-based products, or AI agents.
• Experience testing chatbots or conversational applications.
• Familiarity with Jira, TestRail, or other test management tools.

Tools / Technologies

ChatGPT | Claude | Postman | Selenium | Cypress | Python | Jira | TestRail

Why This Role

• Work on AI systems and LLM-based applications with real-world business use cases.
• Opportunity to develop specialised expertise in AI/LLM quality assurance.
• Work closely with product and engineering teams in a fast-paced technology environment.