About Us:
Deccan AI experts is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving innovation and positive societal impact.
About the Role:
You will evaluate and annotate tasks that require multi-step logical reasoning, cross-domain synthesis, and complex inference generation. You will analyze scenarios spanning mathematics, science, humanities, and real-world problem solving to assess the correctness, clarity, and structure of multi-hop reasoning pathways.
Responsibilities
- Annotate and evaluate multi-hop reasoning tasks that require chaining facts, concepts, or evidence across multiple steps
- Review AI-generated answers for logical consistency, completeness, and correctness at each intermediate reasoning steps.
- Identify and tag breakdowns such as missing hops, unsupported inferences, circular reasoning, or incorrect fact integration.
- Assess synthesis quality, including how well multiple sources or ideas are combined into a coherent final answer.
- Compare and rank multiple AI-generated responses based on reasoning depth, accuracy, clarity, and faithfulness to source information.
- Evaluate whether conclusions logically follow from intermediate steps and cited evidence.
- Provide structured feedback to help improve AI performance on complex reasoning and long-context tasks.
Skills & Experience Required
- Any research background with 25 yrs analytical experience.
- Strong multi-hop reasoning and synthesis skills.
- Ability to detect subtle logical issues in complex analyses.
- comfortable analyzing long reasoning chains and multi-source inputs.
Why Join Us
- Work on high-impact projects that contribute to building AI for Good.
- Collaborate with top-tier engineers and domain experts from IITs, NITs, and BITS.
- Opportunity to grow in a fast-paced, innovation-driven environment.
NOTE: This will be a flexible freelancing opportunity. Pay will vary by project and typically is up to 1500 per hour.
