Job Title: LLM Business Analyst
Experience: 5+ Years
Role Overview
We are seeking a detail-oriented Business Analyst to support Large Language Model (LLM) evaluation and annotation workflows. This role focuses on assessing quality, accuracy, and structured reasoning in model outputs. The ideal candidate is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, evidence-based justifications through fact-checking.
This is an evaluation and quality-focused roleno model training or coding expertise is required.
Key Responsibilities
- Perform side-by-side (SxS) evaluations on GHD outputs, assessing quality, accuracy, relevance, and reasoning
- Conduct fact-checking to validate information and identify inaccuracies or inconsistencies
- Provide clear, well-structured justifications to support evaluation decisions
- Follow established evaluation guidelines and quality standards consistently
- Use browser-based tools and extensions to support review and analysis tasks
- Execute basic command-line instructions when required (no advanced programming)
- Document findings clearly and communicate insights to stakeholders as needed
Required Skills & Qualifications
- 5+ years of professional experience
- Strong comfort using a computer in a professional setting
- Experience working with browser extensions and online tools
- Ability to run basic command-line commands
- Strong analytical and critical thinking skills
- High attention to detail with the ability to justify decisions objectively
- Comfortable working with evaluation frameworks, comparisons, and structured analysis
- Good written communication skills in English
Nice to Have
- Previous experience in evaluation, annotation, QA, or audit-type roles
- Familiarity with data quality, content evaluation, or model/output assessments
- Background in business analysis, operations, or process improvement
If Intrested. Please submit your CV to [Confidential Information] or share it via WhatsApp at 8827565832
Stay updated with our latest job opportunities and company news by following us on LinkedIn: :https://www.linkedin.com/company/sourcebae
