V
AI Assurance Architect
Job Description
GenAI Assurance Architect
Responsibilities
Responsibilities
- Identify the most effective architectures and models to solve complex data problems around Quality Engineering using GenAI
- Apply GenAI in automating different aspects of STLC such as Test artefact generation, defect prediction, defect triaging, failure analysis, test optimization and self-healing.
- GenAI systems validation including RAG based LLMs for Q&A, generated content and recommendations
- Validate performance, security, finetuning and feedback function for LLM based applications
- Build solutions to ensure fairness and trustworthiness of GenAI systems by performing automated tests for prompt safety, response accuracy, relevancy, toxicity, biasness and explainability
- Lead, mentor, and advise the team members in deploying LLMs and AI models for specified use cases
- Document, summarize and present findings and recommendations for Continuous improvement of AI/GenAI implementations across Quality Assurance & Quality Engineering
More Info
Key Skills
GenAI
RAG based LLMs
Finetuning
LLMs
Relevancy
Self-healing
Explainability
toxicity
AI models
Test optimization
Prompt safety
Defect prediction
Automated tests
Response accuracy
Test artefact generation
Biasness
Defect triaging
Feedback function
