Role Overview: JIRA Expert
We are seeking an Individual (Freelancer) with 1-5 years of experience in annotation, LLM training, or prompt evaluation to support prompt creation, validation, and workflow design in a Jira MCP (Model Context Protocol) environment.
This role involves creating and reviewing prompts, validating their executability using Jira tools and structured datasets, and ensuring alignment between prompts, available tools, and expected outputs. Strong hands-on experience with Jira workflows is highly preferred. Experience with RL Gym, agent tool-calling, or trajectory design is a plus but not required.
- Role type: Freelancer
- Location: Remote
- Compensation: $15 - $20 per hour (based on quality performance and evaluation outcomes)
Key Responsibilities
Prompt Creation & Annotation
- Create clear, realistic prompts aligned with Jira workflows (issue management, user/group updates, comments, and properties).
- Annotate and structure prompts to ensure clarity, completeness, and executability.
- Ensure prompts align with available tools, schemas, and seed datasets.
Prompt Evaluation & Validation
- Review and evaluate prompts for logical correctness and executability.
- Validate prompts using structured Jira data and available tools.
- Identify missing dependencies, data gaps, or logical inconsistencies.
- Ensure prompts can produce expected outputs.
Workflow & Execution Logic Support
- Help define logical execution steps required to create the trajectories for the prompts.
- Support documentation of tool usage, execution flow, and expected results.
- Assist in validating prompt-tool alignment and workflow correctness.
Data Interpretation & Quality Assurance
- Analyze structured datasets, Jira records, and tool schemas.
- Perform logical dry runs to confirm prompt feasibility.
- Ensure high quality, consistency, and accuracy in prompt design and evaluation.
Required Skills & Qualifications
Core Requirements (Must Have)
- 1-5 years of experience in:
- Annotation, data labeling, or LLM training, OR
- Prompt creation, evaluation, or AI model training workflows
- Strong hands-on experience with Jira, including:
- Issue tracking and management
- User and group workflows
- Comments, properties, and issue updates
- Ability to interpret structured datasets and schemas
- Strong analytical thinking and attention to detail
- Ability to evaluate prompt executability and logical flow
Preferred Skills (Good to Have)
- Experience with prompt engineering or tool-augmented LLM workflows
- Exposure to RL Gym environments or agent-based systems
- Experience with agent tool-calling or workflow simulation
- Familiarity with structured workflows (JSON, tool schemas, or execution flows)
Deliverables
- High-quality prompts aligned with Jira workflows and available tools
- Prompt validation and executability assessment
- Documentation of prompt logic and workflow alignment
- Identification and reporting of non-executable or invalid prompts
- Structured annotations and workflow documentation.
Ideal Candidate Profile
- 1-5 years of experience in annotation, LLM training, or prompt evaluation
- Strong practical experience with Jira is highly preferred
- Experience working with structured data and workflows
- Strong attention to detail and logical reasoning
- Ability to understand and evaluate AI-driven workflows
- Exposure to agent workflows or RL environments is a plus, but not required
