Title-Agentic AI Process Catalyst
Location- Bangalore/Chennai/Hyderabad
Experience- 13+
Focus: Governance, Audits, Cadence, Standards, and AI-Human Synergy.
The
Process Catalyst ensures that the guardrails defined by the Champion are actually being hit. They act as the Ethical Inspector.
Key Responsibilities
- Real-time Monitoring & Model Auditing:
- Hallucination Audits: Conduct regular Fact-Check audits on agent logs using RAG (Retrieval-Augmented Generation) evaluation tools to ensure agents are grounded in the provided knowledge base.
- Bias Testing Coordination: Facilitate Red Teaming sessions where agents are intentionally prompted to reveal biases; document these findings and track the remediation in the model's logic.
- Explainability (XAI) Documentation: Ensure every autonomous decision made by an agent is traceable and explainable, maintaining a Decision Log that can be audited by third parties or clients.
- Compliance Checklists: Execute rigorous weekly checks against regulatory requirements (e.g., GDPR Right to Explanation) to ensure the data used for agentic learning is sanitized and consented.
- Quality Engineering: Audit the Chain of Thought (CoT) logs and agentic workflows to ensure they meet the organization's quality standards for logic and security.
- Risk & Ethics:
- Define the governance framework for AI ethics, ensuring transparency in agent decision-making and robust audit trails for global clients.
- Establish guardrails for autonomous agent behavior, including hallucination management, data privacy, and bias mitigation.
- Agile Intervention: Conduct weekly Health Checks on Agentic AI projects. Identify bottlenecks in agent testing or deployment cycles and implement immediate corrective actions.
- Predictive Dashboards: Define the KPIs that matter, moving beyond on-time delivery to Agent Accuracy, Token Efficiency, and Resolution Autonomy.
- Data-Driven Governance: Manage the real-time delivery dashboards, ensuring data integrity and providing the story behind the metrics to the leadership team.
- Stakeholder Alignment: Act as the bridge between technical AI labs and global client executives to ensure process transparency.
Qualifications & Skills
- Experience: 5+ years in Delivery Excellence, with at least 3 years leading AI/ML or automation-heavy programs.
- Expertise: Proficiency in Jira/ADO, PowerBI/Tableau. Hands on Exposure to Agentic AI ecosystem (Prompt engineering, Agentic workflows, RAG, Awareness of various protocols)
- Strategic Mindset: Ability to design processes that account for the non-deterministic nature of Generative AI.
- Certifications: Lean Six Sigma Black Belt, PMP, or specialized AI Governance certifications / Agentic AI
- Soft Skills: Influencing without authority and the ability to translate AI complexity into Business value.