About LetitbexAI
LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.
Position: AI Testing / Model Validation Specialist
Experience: 3-5 Years
Notice Period: Can be considered up 15 Days
Role Summary
Develop and execute comprehensive testing strategies for AI-powered features in various modules. Ensure quality, reliability, and ethical soundness of AI components.
Key Responsibilities
- Develop test plans and strategies for AI-powered recruitment features
- Design test datasets and evaluation suites for model validation
- Execute functional and performance testing of AI components
- Conduct fairness and bias testing on AI-driven decisions
- Implement automated testing frameworks for ML models
- Perform edge case and adversarial testing
- Create dashboards and reports on AI feature quality metrics
- Collaborate with ML engineers on model improvement recommendations
- Document known limitations and edge cases
- Support A/B testing and champion-challenger evaluations
Required Skills & Experience
- 3-5 years of QA experience with exposure to AI/ML products
- Understanding of ML concepts, evaluation metrics, and testing methodologies
- Strong analytical skills and attention to detail
- Proficiency in Python or similar language for test automation
- Experience with test automation frameworks and tools
- Knowledge of statistical testing and data analysis
- Strong communication and documentation abilities
Nice to Have
- Experience with fairness and bias evaluation frameworks
- Knowledge of NLP and language model testing
- Familiarity with ML evaluation platforms or tools
- Experience with automated testing for ML systems
- SQL knowledge for data exploration
