Job Title : Quality Assurance Lead (Playwright +AI)
Location : Bangalore (Hybrid)
Shift time : 12 PM to 9 PM
Experience :5 to 8 years
Job Description
Key Responsibilities
- Define and own the overall QA Strategy, Test Plan, and Automation Roadmap for the platform.
- Establish testing processes across the SDLC including functional, integration, regression, performance, security, and UAT testing.
- Design and implement automated test suites using Playwright.
- Create and maintain test cases, test scenarios, and test data for UI, API, and backend services.
- Collaborate closely with Product Managers, Developers, and Architects to ensure quality is built into the development lifecycle.
- Lead release validation activities and drive defect triage and resolution.
- Define quality metrics, test coverage goals, and release readiness criteria.
- Mentor QA engineers and promote QA best practices across the team.
- Evaluate and recommend testing tools, frameworks, and CI/CD quality gates.
AI Testing Responsibilities
- Design and execute test strategies for AI-powered features, agentic workflows, and LLM integrations.
- Validate AI evaluation outputs for quality, consistency, safety, and reliability.
- Define test datasets, evaluation scenarios, and acceptance criteria for AI use cases.
- Perform prompt, workflow, and integration testing for AI agents and evaluation pipelines.
- Collaborate with engineering teams to establish repeatable AI testing and regression validation processes.
Required Skills
- 5–8 years of experience in Software Quality Assurance and Test Automation.
- Strong hands-on experience with Playwright for UI automation.
- Experience testing REST APIs using tools such as Postman, Swagger, or equivalent frameworks.
- Experience creating Test Strategy, Test Plan, and Automation Strategy documents.
- Strong understanding of SDLC, STLC, Agile, and CI/CD practices.
- Experience with test management and defect tracking tools (e.g., Jira, Azure DevOps).
- Good understanding of database testing and SQL.
- Experience defining quality metrics and release readiness criteria.
- Preferred Skills
- Hands-on experience using AI-assisted development tools such as Claude, GitHub Copilot, Cursor, or equivalent AI coding assistants to accelerate test case creation, automation scripting, test data generation, and QA productivity.
- Ability to effectively leverage AI tools for generating and reviewing automation scripts while ensuring code quality, maintainability, and accuracy through human validation.
- Experience testing AI/LLM, Agentic AI, ML, or GenAI applications.
- Exposure to AI evaluation concepts such as quality, safety, performance, hallucination, and response validation.
- Experience with performance and load testing tools.
- Familiarity with AWS cloud environments and modern SaaS applications.
- Experience testing event-driven and microservices-based architectures.
