We're Hiring: English Language Experts for AI Evaluation (Remote | India)
We are hiring English Language Experts for AI Query Vetting and Evaluation workflows. This is a specialized role focused on evaluating real user queries and AI-generated responses to ensure high standards of quality, factuality, and safety. This is not a content writing or prompt testing role.
Key Responsibilities
- Perform English-language query vetting without altering user intent
- Evaluate AI responses across:
- Helpfulness & Quality
- Factual Accuracy
- Safety, Sensitivity & DEI
- Source Trustworthiness
- Value Addition
- Assign PASS / FAIL decisions with clear justifications
- Conduct Side-by-Side (SxS) evaluations across AI platforms
- Perform factuality checks and identify hallucinations
- Maintain documentation including evaluation sheets and notes
Requirements
- Location: India (Remote)
- Master's degree in Linguistics, Communication, Journalism, Translation, Interpretation, Data Science, or related fields
- C2-level English proficiency (mandatory)
- Native-level Hindi proficiency (written and spoken)
Experience (2+ years):
- AI Evaluation / LLM QA / Search Quality / Query Vetting
- Hands-on experience with PASS/FAIL frameworks
- Experience evaluating real AI outputs
Core Skills
- Strong analytical thinking and attention to detail
- Ability to assess factuality, quality, and safety
- Structured and clear reasoning skills
- Comfortable working with global teams and guidelines
Work Details
- Remote (India)
- IST hours with overlap with PST/CST teams
- Up to 35 hours per week
Apply
Send your CV to: [Confidential Information]
