Data Annotator

Job Description

• This is a remote, project-based role for experienced practitioners across any professional domain who can apply their real-world expertise to data annotation tasks. You will review, label, and evaluate data samples — including text, documents, model outputs, and domain-specific content — providing expert judgment, structured annotations, and reasoned assessments that require genuine hands-on professional experience. This position offers exceptional pay, exposure to cutting-edge AI development workflows, and a strong addition to your professional portfolio.

Why Apply

• Flexible Time Commitment – Work on your schedule while contributing meaningful domain expertise
• Exceptional Pay
• Portfolio Building – Gain experience contributing expert knowledge to real-world AI and data projects
• Professional Growth – Apply your domain expertise in a novel, high-impact context at the frontier of AI development

Responsibilities

• Review and annotate data samples — including text, documents, and model-generated outputs — using structured labeling frameworks and annotation guidelines
• Apply domain-specific expertise to evaluate the accuracy, quality, and appropriateness of content requiring professional judgment
• Provide detailed reasoning, justifications, and source citations to support annotation decisions
• Flag ambiguous, inconsistent, or out-of-scope samples and escalate with clear written explanations
• Document annotation decisions consistently and reproducibly in line with project-specific guidelines

Required Qualifications

• 3+ years of professional experience in any domain requiring specialized expertise (e.g., law, medicine, engineering, finance, science, or similar)
• Strong analytical and critical thinking skills with the ability to apply professional judgment to complex, nuanced content
• Excellent written communication skills and ability to produce clear, structured, citation-supported annotations
• Ability to work independently, follow detailed guidelines, and maintain high accuracy across large volumes of review tasks

Preferred Qualifications

• Prior experience with data annotation, content review, or AI model evaluation workflows
• Familiarity with annotation platforms and structured labeling tools
• Advanced degree or professional certification in a relevant domain
• Experience producing structured written analyses, legal memos, research reports, or technical documentation in a professional setting

Company Description

• AfterQuery is a research lab investigating the boundaries of artificial intelligence through novel datasets and experimentation. We're backed by top investors, including Y Combinator and Box Group, and support all leading AI labs.