Vice President Quality Engineering Leader

Inviting applications for the role of Vice President - Quality Engineering Leader

Genpact is leading the next frontier in AI with the transition to Agentic AI systems-autonomous, reasoning-driven agents capable of planning and executing complex workflows. To accelerate this transformation, we are seeking a visionary Head of Quality Engineering to dismantle legacy manual processes and build a world-class, fully automated validation ecosystem from the ground up.

In this role, you will not simply test AI systems-you will define the global standard for how autonomous agents are governed, evaluated, safeguarded, and deployed at enterprise scale.

Responsibilities

1. Architect the Future of AI Quality

• Design and implement a scalable, automation-first validation framework purpose-built for Agentic AI lifecycle management.

• Develop methods to reliably evaluate non-deterministic model outputs at scale.

2. Drive the Shift to Quality as Code

• Lead the organizational and technical transition toward continuous, AI-driven testing pipelines integrated into modern CI/CD environments.

• Replace manual QA processes with highthroughput automation systems.

3. Advance Agentic Evaluation Science

• Build frameworks to measure:

• Agentic reasoning and decision chains

• Tool-calling accuracy

• Multi-step goal achievement

• Workflowlevel consistency and reliability

4. Lead Red Teaming & Safety Engineering

• Establish adversarial testing protocols to protect systems against:

• Bias and hallucinations

• Unsafe or ungrounded decisions

• Role drift and autonomy failures

• Partner with Security and AI Governance teams to enforce high safety and compliance standards.

5. Build Scalable Evaluation Infrastructure

• Implement automated evaluation harnesses using tools such as RAGAS, DeepEval, and synthetic data generators.

• Develop custom frameworks for benchmarking LLM and agentic performance in realworld enterprise settings.

Qualifications we seek in you!

Minimum Qualifications

The AI Polymath

• Deep understanding of the difference between testing deterministic software and evaluating stochastic AI systems.

• Ability to translate qualitative heuristics (vibe checks) into quantitative, automated evaluation metrics.

Automation Evangelist

• Extensive experience replacing manual QA processes with fully automated, CI/CD-integrated validation suites.

• Proven success modernizing large QA functions into engineering-driven Quality organizations.

Preferred Qualifications/ Skills

Technical Depth

• Strong proficiency in Python.

• Hands-on experience with LLM orchestration frameworks such as LangChain or LlamaIndex.

• Familiarity with observability and evaluation systems:

• LangSmith

• Arize Phoenix

• Other agent telemetry platforms

Leadership & Transformation Experience

• Demonstrated ability to lead teams through high-impact transformation.

• Skilled at upskilling traditional testers into AI-focused Quality Engineers or hiring specialized talent.

• Able to influence senior stakeholders and advocate for a modern quality philosophy.