QA Analyst - AI/ML

TITLE: QA ANALYST — AI/ML

Location: Bangalore | Work mode: Hybrid Experience: 6+ years QA experience (required)

About the role We're hiring a seasoned QA Analyst to own AI/ML testing with a heavy focus on voice AI. The role requires a confident, independent thinker who will design and run hundreds of call test scenarios, document results, coordinate voice testing with US teammates, and develop/maintain automation to improve coverage and efficiency.

Key Responsibilities

• Own end-to-end AI/voice QA process: plan tests, create and maintain test artifacts, run tests, track defects, and sign off releases.
• Design, author, and maintain hundreds of call/call-flow test scenarios and test matrices (currently tracked in spreadsheets).
• Execute functional and exploratory testing of voice AI systems (IVR, conversational agents, ASR/NLU, TTS), including negative and edge-case scenarios.
• Develop, maintain, and extend test automation for regression and smoke suites (API, integration, and end-to-end voice test automation).
• Build automated test harnesses and pipelines to validate model outputs, call flows, and telephony integrations; integrate tests into CI/CD.
• Validate AI model outputs for correctness, safety, bias, and regressions; document behavioral drift and failure modes.
• Coordinate and delegate voice test execution to US-based teammates, call center agents, or third parties; manage logistics and communication.
• Improve QA processes: identify automation candidates, increase test coverage, and optimize documentation/workflows.
  

Required Qualifications

• 6+ years professional QA experience with demonstrable ownership of QA processes.
• 4+ years of hands-on QA automation experience using Selenium or Cypress.
• Direct experience testing AI systems, ML models, or conversational agents (voice AI experience strongly preferred).
• Strong knowledge of JavaScript/TypeScript, Java, or Python for automation scripting.
• Experience in API testing using Postman, RestAssured, or SoapUI.
• Excellent spoken and written English - native fluency required.
• Strong test-design skills, with proven ability to author large volumes of test cases and call scenarios.
• Proven experience in QA automation: designing test frameworks, writing automated tests (API, integration, E2E), and integrating with CI/CD.
• Comfortable owning cross-functional communication and coordinating remote test execution with external parties.
• Experience working with spreadsheets for large test suites; familiarity with test management tools (JIRA, TestRail, Zephyr) is preferred.
• Strong analytical skills; ability to reproduce non-deterministic AI behaviors and document them clearly.
• Proficient in scripting/programming for automation and log analysis; familiarity with data formats (JSON, CSV).
• Proven initiative and process-improvement orientation.