Company Overview
Docusign brings agreements to life. Over 1.5 million customers and more than a billion people in over 180 countries use Docusign solutions to accelerate the process of doing business and simplify people's lives. With intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were disconnected from business systems of record, costing businesses time, money, and opportunity. Using Docusign's Intelligent Agreement Management platform, companies can create, commit, and manage agreements with solutions created by the #1 company in e-signature and contract lifecycle management (CLM).
What you'll do
We are looking for a Senior AI Functional Test Engineer to lead quality efforts for AI-powered platform applications and business agents. This role focuses on validating end-to-end business workflows, AI decisioning, and platform integrations.
This position is an individual contributor role reporting to the Senior Manager SDET.
Responsibility
- Own end-to-end functional testing of AI-driven platform applications and business agents, which are built using Crew.ai
- Lead AI test strategy for platform and function
- Validate AI decision workflows, recommendations, and rule-based + ML-driven outcomes
- Design test strategies for multi-system integrations, APIs, and platform services
- Test agent-based chat bot systems (conversational AI)
- Perform data validation across upstream/downstream systems to ensure business accuracy
- Identify gaps in real-world business scenarios, edge cases, and failure handling
- Drive UAT support and stakeholder alignment for business-critical flows
- Partner with Product, Engineering, and Data teams to ensure release readiness Design and implement AI testing frameworks that support all different applications
Job Designation
Hybrid: Employee divides their time between in-office and remote work. Access to an office location is required. (Frequency: Minimum 2 days per week; may vary by team but will be weekly in-office expectation)
Positions at Docusign are assigned a job designation of either In Office, Hybrid or Remote and are specific to the role/job. Preferred job designations are not guaranteed when changing positions within Docusign. Docusign reserves the right to change a position's job designation depending on business needs and as permitted by local law.
What you bring
Basic
- 8+ years in QA / Functional Testing, with exposure to AI/ML-based systems
- Strong experience in platform-level and end-to-end integration testing
- Hands-on with API testing (Postman/REST) and data validation (SQL)
- Experience testing AI agents, decision engines, and MCP servers
- Deep understanding of business process validation (Order-to-Cash, Billing, Subscriptions, etc.)
- Ability to validate AI outputs for accuracy, consistency, and business relevance
- Performance testing of AI applications
- Build the AI test-driven platforms for measuring accuracy, fact-checking, and efficiency
- Experience with Python automation and Arize tools
- Exposure to LLMs, conversational AI, or GenAI-based agents
- Experience working in Agile / fast-paced platform environments
- Proficiency in cloud platforms such as AWS and Azure
Preferred
- Arize tool testing experience
- Salesforce/ERP application knowledge
- JIRA knowledge
- deep understanding of the testing and execution life cycle
- One or more certifications such as Cloud, Solution Architect, Technical Architect, or GenAI-related certifications
- Understanding of performance, stress, and volume testing concepts
- Strong analytical, problem-solving, and communication skills
- Familiarity with performance testing tools such as JMeter, Gatling, Blazemeter
- Understanding of performance, stress, and volume testing concepts
Life at Docusign
Working here
Docusign is committed to building trust and making the world more agreeable for our employees, customers and the communities in which we live and work. You can count on us to listen, be honest, and try our best to do what's right, every day. At Docusign, everything is equal.
We each have a responsibility to ensure every team member has an equal opportunity to succeed, to be heard, to exchange ideas openly, to build lasting relationships, and to do the work of their life. Best of all, you will be able to feel deep pride in the work you do, because your contribution helps us make the world better than we found it. And for that, you'll be loved by us, our customers, and the world in which we live.
Accommodation
Docusign is committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. If you need such an accommodation, or a religious accommodation, during the application process, please contact us at [Confidential Information].
If you experience any issues, concerns, or technical difficulties during the application process please get in touch with our Talent organization at [HIDDEN TEXT] for assistance.
Applicant and Candidate Privacy Notice
