Job Description
Job Requirements
At Quest Global, it's not just what we do but how and why we do it that makes us different. With over 25 years as an engineering services provider, we believe in the power of doing things differently to make the impossible possible. Our people are driven by the desire to make the world a better place—to make a positive difference that contributes to a brighter future. We bring together technologies and industries, alongside the contributions of diverse individuals who are empowered by an intentional workplace culture, to solve problems better and faster.
About The Role
You are not a traditional QA Lead. You are the architect of test scenarios that AI agents execute, the author of golden sets that judge whether the AI is good enough, and the owner of platform quality for a product whose entire output is quality signals.
You will lead a small team of QA engineers, partner directly with AI engineers on prompt evaluation, drive flake detection and quarantine, and own the curated MVP scenario library that becomes the seed corpus for the autonomous Scenario Generation Agent in Phase 2.
Role Expectation
Curate the MVP scenario library — All the hand-authored production-grade scenarios across OS Regression, UI/UX, and Performance modules
Author the golden test sets that benchmark AI agent decision quality (precision/recall per agent)
Design and run the 3-run stability gate that promotes generated scenarios to production
Own flake detection and quarantine — statistical detection of unstable scenarios, root-cause investigation
Build the QA test plan that regression-tests AussreDroid AI itself
Define and enforce scenario authoring standards — goal language, setup actions, validation checks, performance baselines
Lead the Scenario Generation Agent validation loop — review, accept/reject, refine
Drive partner onboarding playbooks for 1P and 3P app teams
Must-Have Skills
6+ years QA / test engineering with at least 3 years in test architecture or automation leadership
Deep experience with Android testing — Espresso, UI Automator, ADB, test pyramid for mobile
Hands-on with Appium, Selenium, or equivalent automation frameworks
Strong scenario design discipline — what to test, what to skip, edge cases, negative paths
Experience evaluating AI/ML system quality — precision, recall, golden sets, A/B testing
Familiarity with statistical methods — flake rate analysis, confidence intervals
Comfortable with Python (you'll author scenario YAML and review framework code)
Strong technical writing — scenario goals are read by LLMs, ambiguity costs accuracy
Nice to Have
Background in mobile QA at scale (Google, Meta, Uber, Spotify, banking apps)
Experience with performance testing — memory profiling, CPU benchmarking, battery analysis
Familiarity with Material Design 3 and Play Store quality guidelines
Exposure to AI testing tools or LLM evaluation frameworks
Past QA team leadership experience
We are known for our extraordinary people who make the impossible possible every day. Questians are driven by hunger, humility, and aspiration. We believe that our company culture is the key to our ability to make a true difference in every industry we reach. Our teams regularly invest time and dedicated effort into internal culture work, ensuring that all voices are heard.
We wholeheartedly believe in the diversity of thought that comes with fostering a culture rooted in respect, where everyone belongs, is valued, and feels inspired to share their ideas. We know embracing our unique differences makes us better, and that solving the worlds hardest engineering problems requires diverse ideas, perspectives, and backgrounds. We shine the brightest when we tap into the many dimensions that thrive across over 21,000 difference-makers in our workplace.
