Search by job, company or skills

codvo.ai

Senior QA Lead – AI & Automation (10+ Years)

10-12 Years
Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted 12 days ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Description: Senior QA Lead – AI & Automation (10+ Years)

Role Overview

We are looking for a Senior QA Lead with strong expertise in AI-based application testing and API automation to lead quality initiatives across our AI-driven products, including a Meeting Assistant (Agentic AI) and Legal SDL platform. This role will drive QA strategy, ensure high-quality releases, and build scalable automation frameworks.

Key Responsibilities

  • Define and own the overall QA strategy across AI-driven products
  • Lead end-to-end testing for Agentic AI systems (meeting assistant, conversational workflows)
  • Drive API-first automation strategy and ensure high test coverage
  • Validate AI/ML components including prompts, responses, and model behavior
  • Establish test frameworks, CI/CD integration, and quality gates
  • Collaborate with Product, Engineering, and AI teams to ensure testability and quality
  • Manage test planning, execution, reporting, and release sign-offs
  • Mentor QA engineers and build a high-performing QA team
  • Define metrics, dashboards, and quality KPIs

Required Skills & Experience


  • 10+ years of experience in Software QA / Testing
  • Strong expertise in API Automation (Postman, RestAssured, PyTest, etc.)
  • Hands-on experience in UI Automation (Selenium, Playwright, Cypress)
  • Experience in AI/ML testing (LLMs, chatbots, conversational AI)
  • Understanding of:
  • Prompt validation & response evaluation
  • Hallucination detection
  • Model output validation
  • Strong knowledge of test management practices and tools (JIRA, qTest, TestRail, ADO)
  • Experience in CI/CD pipelines (Jenkins, GitHub Actions, etc.)
  • Strong debugging and root cause analysis skills

Good to Have


  • Experience with Agentic AI systems
  • Exposure to NLP / LLM evaluation frameworks
  • Performance testing of AI systems
  • Knowledge of cloud platforms (AWS/Azure)

Leadership Expectations


  • Ability to own QA delivery across multiple products
  • Strong stakeholder communication
  • Proactive quality ownership and decision-making

Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 145744519

Similar Jobs