About The Role
DoubleTick is hiring a QA Engineer for its AI Solutions vertical — a newly formed internal practice that designs, builds, and deploys AI-powered conversational flows for enterprise clients on WhatsApp, Voice, and other channels.
This is not a product stress-testing role. The core product is already built. What changes per deployment is the prompt architecture, intent filters, and query logic. Your job is to validate that every AI deployment — voice bot, chat agent, or automation flow — behaves exactly as designed before it goes live with an enterprise client.
You will work directly alongside Forward-Deployed Engineers, AI Engineers, and Solution Engineers as a core part of the delivery team — not as a downstream function.
What you'll do
AI Deployment Validation
- Build and maintain AI test suites for AI voice and chat deployments across WhatsApp, PSTN, and SIP channels.
- Validate prompt behaviour, intent classification accuracy, fallback handling, and response quality across defined user journeys.
- Test end-to-end integration flows — from user input through LLM processing to API callbacks and CRM/backend updates.
- Identify and document edge cases in conversational logic that neither the product team nor client strategy teams typically surface.
Test Infrastructure & Documentation
- Define and maintain a standardised playbook of test cases for recurring deployment patterns (sales bots, support agents, lead qualification flows, etc.).
- Author VRDs (Validation & Requirement Documents) in collaboration with Solution Engineers — documents that translate client requirements intIsDSo testable acceptance criteria.
- Ensure VRDs are implementation-ready and serve as the source of truth for Go-live sign-off across delivery projects.
- Maintain test logs, failure reports, and regression records per deployment.
Cross-functional Delivery Ownership
- Be present across the full delivery lifecycle — from solutioning review to UAT to post-deployment monitoring.
- Raise quality flags proactively during project scoping, not just at the testing stage.
- Act as the quality gate before any AI solution goes live with an enterprise client.
What we are looking for
Must have
- 1–5 years of experience in QA, with at least some exposure to API testing or conversational/AI product testing.
- Ability to think in user journeys and edge cases — not just pass/fail checklists.
- Proficiency with API testing tools (Postman or equivalent) to validate webhook flows and integration endpoints.
- Strong documentation instinct — you write test cases and findings that others can act on without asking you follow-up questions.
- Comfort working in fast-moving, ambiguous delivery environments with multiple stakeholders.
Good to have
- Prior experience testing LLM-based products, chatbots, or voice bots.
- Familiarity with WhatsApp Business API or any conversational platform.
- Basic scripting ability (Python or JS) to automate repetitive test scenarios.
- Exposure to tools like Jira, Notion, or any structured project delivery environment.
What Success Looks Like
- Zero post-Go-live critical failures attributable to untested conversational logic.
- A growing, reusable test case library that reduces QA cycle time per deployment.
- VRDs that are consistently implementation-ready with no back-and-forth on scope.
- You're the person the delivery team pulls in early — not at the end.
About DoubleTick
DoubleTick is a mobile-first conversational CRM built on the official WhatsApp Business API, serving 10,000+ businesses across India and UAE. Backed by Info Edge Ventures and BeeNext, we power customer conversations for brands like MakeMyTrip, Royal Enfield, CoinDCX, Malabar Gold, and Sabyasachi.
Our AI Solutions vertical is where this role lives — building next-generation AI deployments on top of our platform for enterprise clients.
