AI Evaluation Specialist | 50/Task

Domain Expert – AI Prompt Design & Evaluation

Experience: Professional / Domain Expertise Required

Job Type: Contractor

Schedule: Global - Flexible

Compensation:$50 per approved task

Role Overview

We are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt, test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs.

Key Responsibilities

• Convert a familiar, complex workflow into a challenging AI prompt.
• Test the prompt using ChatGPT and identify incomplete or incorrect outputs.
• Refine the task to better test the model's reasoning capabilities.
• Record your screen, camera, and microphone while completing the task.
• Create a clear and comprehensive grading rubric.
• Submit the final prompt, failure notes, rubric, and generated output file.

Key Requirements

• Strong expertise in a specialized professional or technical workflow.
• Ability to quickly evaluate the quality and accuracy of outputs in your domain.
• Strong reasoning, analytical, and problem-solving skills.
• Access to a laptop or desktop computer.
• Active ChatGPT account; free tier is acceptable.
• Comfortable completing a screen-recorded session with audio and video.

Selection Process

Step 1 – Application / Profile Submission

Step 2 – Paid Trial Assessment

Step 3 – Submission Review

Step 4 – Payment & Future Opportunities