Responsibilities
- Own quality activities for product features from requirement review and test planning through release validation and production follow-up.
- Design, develop, and maintain Python-based Robot Framework automation for API, UI, integration, and end-to-end product workflows.
- Build and enhance Playwright automation for reliable cross-browser testing of modern web applications.
- Perform functional, exploratory, regression, integration, and release testing for our B2B Commerce platform.
- Create reusable test libraries, data utilities, fixtures, and reporting capabilities that improve automation scalability and maintainability.
- Integrate automated tests into CI/CD pipelines and help establish effective quality gates, failure triage, and release-readiness reporting.
- Collaborate closely with product managers, developers, and team members in the US and India to clarify requirements and deliver the product roadmap.
- Contribute to testing AI-enabled capabilities, including LLM response quality and RAG-based product experiences, where applicable.
- Review defects and production issues, support root-cause analysis, and improve regression coverage to prevent recurrence.
- Maintain a strong focus on technical excellence, reliability, usability, customer impact, and continuous quality improvement.
Requirements
- You have strong experience testing enterprise-grade web applications and SaaS products across UI, API, and integration layers.
- You have hands-on programming experience in Python and use it to build maintainable, reusable, and reliable test automation.
- You have practical experience developing API and UI automation using Robot Framework.
- You have experience with Playwright for modern web application testing, preferably using Python.
- You understand product requirements, user workflows, acceptance criteria, and business risks, and translate them into effective test coverage.
- You are comfortable combining automation with exploratory, functional, regression, integration, and end-to-end product testing.
- You investigate failures systematically, identify root causes, and communicate defects with clear evidence and business impact.
- You work closely with product management, engineering, and design to prevent defects and improve overall product quality.
- You are comfortable collaborating with globally distributed teams and taking ownership of quality throughout the delivery lifecycle.
- You are interested in learning, growing, and leading by example.
- Engineering graduate with 3-5 years of industry experience in software quality assurance and product testing.
- Strong hands-on programming and scripting experience in Python.
- Experience designing and maintaining automated test suites using Robot Framework.
- Experience automating REST API testing, including request validation, authentication, response schemas, error handling, and data-driven scenarios.
- Experience automating web UI workflows using Playwright and applying stable locator, synchronisation, and test-isolation practices.
- Good understanding of test design techniques, test strategy, risk-based testing, defect lifecycle, and release validation.
- Experience testing end-to-end product workflows across frontend, backend services, databases, and third-party integrations.
- Working knowledge of SQL and relational databases such as PostgreSQL or MySQL for backend data validation.
- Experience with Git, CI/CD pipelines, automated test execution, and test reporting.
- Familiarity with cloud-based or SaaS product environments and testing across multiple deployment environments.
- Ability to debug automation failures, application issues, network/API problems, and environment-specific defects.
- Strong communication skills and the ability to contribute effectively to engineering, product, and release discussions.
- Ability to work in a fast-paced environment with rapidly evolving business requirements.
- A hands-off or not my job attitude is an absolute no-go.
Preferred Experience
- Experience evaluating applications powered by Large Language Models or Generative AI.
- Understanding of Retrieval-Augmented Generation workflows, including retrieval, context construction, prompt execution, and response validation.
- Exposure to LLM and RAG quality metrics such as answer relevance, faithfulness or groundedness, context precision and recall, answer correctness, hallucination rate, safety, latency, and cost.
- Experience validating prompts, model responses, embeddings, vector search, citations, and AI-agent workflows.
- Startup or B2B SaaS product experience is a strong plus.
This job was posted by Priti Pradhan from Axiamatic.
