Skills : AI Tester
Experience : 12+ Years
Location : All LTIM Office
Key Responsibilities
Functional & Model Testing
- Design and execute test cases for AI/ML models, including classification, NLP, recommendation, and generative AI systems
- Validate model outputs for accuracy, consistency, and expected behavior across diverse inputs
- Perform regression testing after model updates, retraining cycles, or data changes
Prompt & LLM Testing
- Develop and maintain prompt test libraries for large language model (LLM)-based features
- Evaluate model responses for relevance, tone, factual accuracy, and adherence to business rules
- Identify hallucinations, response drift, and edge-case failures in generative outputs
AI Safety & Red Teaming
- Conduct adversarial testing to identify vulnerabilities such as prompt injection, jailbreaks, and unintended model behaviors
- Assess outputs for bias, fairness, and compliance with responsible AI principles
- Document risk findings and collaborate with model teams to drive remediation
Test Automation & Tooling
- Build and maintain automated test suites for AI pipelines using Python-based frameworks
- Integrate AI testing into CI/CD workflows and contribute to evaluation infrastructure
- Track and report quality metrics, model performance benchmarks, and defect trends
Collaboration & Documentation
- Partner with data scientists, ML engineers, and product teams throughout the development lifecycle
- Write clear test plans, defect reports, and evaluation summaries
- Contribute to internal QA standards and best practices for AI systems
