We're reinventing the market research industry. Let's reinvent it together.

At Numerator, we believe tomorrow's success starts with today's market intelligence. We empower the world's leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

QA Engineer - Tribeo Panel Smart 4 / Panel Smart 5 (Questions by Mobile)

Core Technology Stack: Azure DevOps (ADO), Jira, SQL, API testing, AI productivity tools, and mobile testing across Panel Smart solutions

Role Purpose

The purpose of this role is to support the delivery of high-quality products by ensuring functional requirements are met and that users receive reliable and effective experiences. The role contributes to quality assurance through the planning, design, execution, and reporting of manual testing activities across relevant environments, as applicable. In this context, PS4 and PS5 refer to Panel Smart mobile-based solutions used to support questionnaires and survey experiences.

Core Responsibilities

Requirements & Scope
- Review User Stories and Change Requests to support clarity of acceptance criteria and identify edge cases, data dependencies, and potential gaps.
- Contribute to risk-based analysis by identifying high-impact business scenarios and key customer workflows.
- Collaborate with Product and Business Analyst teams during backlog refinement to improve requirement clarity and testability.
Test Design
- Develop and maintain test cases and checklists covering key functional, negative, boundary, permissions, and localization scenarios.
- Prepare reusable test data and support environment readiness, including documentation of pre-conditions and clean-up steps.
- Identify regression scenarios and potential candidates for future automation coverage.
- Use AI tools, where appropriate, to support test case drafting, test data preparation, and documentation activities.
Execution & Evidence
- Execute manual test cases, capture clear evidence (such as screenshots and logs), and maintain accurate results in Azure DevOps (ADO) or Jira.
- Carry out exploratory, sanity, and regression testing, re-test fixes, and support story completion where acceptance criteria have been met.
- Perform risk-based testing and support the validation of changes in line with business priorities.
- Validate end-to-end customer journeys and critical business processes across integrated systems.
- Use AI-assisted tools, where appropriate, to support log analysis, defect pattern identification, and repetitive validation activities.
Defect Management
- Raise well-structured defects, including clear reproduction steps, environment details, expected and actual results, and appropriate impact assessment.
- Contribute to daily triage, verify fixes, and monitor issues through to resolution.
- Carry out impact analysis to identify potential downstream risks associated with defects and changes.
Collaboration & Reporting
- Participate in sprint ceremonies and provide timely status updates and release readiness reporting.
- Work collaboratively with Product, Business Analysts, and Development teams to support clear requirements and improved testability.
- Collaborate with Automation QA and Development teams to support automation coverage and continuous quality improvement initiatives.
- Contribute to continuous improvement discussions, quality practices, and shift-left testing activities.

Skills & Requirements

Skills & Experience

Core testing skills: Test design, defect management, regression testing, data validation, API testing, and log analysis.
Tools and methodologies: ADO, Jira, SQL, Agile/Scrum, SDLC/STLC, risk-based testing, and effective use of AI tools.
Behavioral competencies: Customer-focused mindset, strong communication, attention to detail, collaboration, and critical review of outputs.
Emerging skills: Foundational understanding of AI-assisted quality engineering, including support for regression maintenance, flaky test analysis, UI change impact identification, basic awareness of RAG-based solutions, and the responsible use of enterprise-approved AI and automation tools to improve testing efficiency, insight generation, and continuous quality improvement.

KPIs & Success Metrics

Test Case Execution: Completion of at least 95% of planned test cases within each sprint.
Defect Detection: Identification of at least 90% of Severity 1 and Severity 2 defects before release.
Bug Quality: Inclusion of clear reproduction steps, environment details, and supporting evidence in 100% of defects raised.
Turnaround: Triage and assignment of all newly raised defects within 24 hours.
Coverage: Maintenance of 100% coverage of acceptance criteria and critical scenarios, with the regression suite updated for each sprint.
Reporting Discipline: Provision of timely daily updates and end-of-sprint summaries, including risks and go/no-go recommendations.
Stakeholder Satisfaction: Positive stakeholder feedback on the clarity and value of test reporting through quarterly pulse reviews.
Continuous Improvement: Active contribution to process improvement, shift-left quality initiatives, and knowledge sharing.
AI Adoption and Productivity: Effective and responsible use of approved AI tools to support testing efficiency and quality outcomes.

QA Engineer 2 - Mobile Apps - Tribeo (PS5)