About Us:
Deccan AI Experts is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving innovation and positive societal impact.
About the Role
We are looking for an experienced Python Developer to contribute to annotation and RLHF initiatives focused on code understanding and evaluation. In this role, you will review and annotate real-world Python code, validate patches, execute and analyze test suites, and identify root causes of failures through structured debugging and reasoning. You will work with production-grade repositories and pull requests, carefully assessing logic, edge cases, and runtime behavior, and providing high-quality human feedback that helps improve the reliability, correctness, and reasoning capabilities of advanced AI models.
Key Responsibilities
- Review, analyze, and annotate Python code, patches, and pull requests for RLHF and AI training datasets.
- Evaluate Python implementations for correctness, logic flow, edge cases, and maintainability
- Execute, analyze, and annotate results from Python test suites (pytest, unittest, or similar).
- Annotate differences between correct vs incorrect solutions, highlighting bugs, inefficiencies, and risks
- Evaluate code involving data processing, APIs, concurrency, async logic, or scripting workflows.
- Label code quality aspects such as readability, performance implications, and best-practice adherence.
- Review real-world repositories and simulated PRs to generate high-quality labeled examples.
- Ensure annotations are precise, consistent, and aligned with defined project guidelines.
Required Skills & Experience
- 15 years of hands-on experience with Python development
- Strong understanding of Python fundamentals, data structures, and standard libraries
- Experience with pytest, unittest, or similar testing frameworks
- Ability to debug runtime errors, logical bugs, and edge cases in Python code.
- Familiarity with Git workflows, code reviews, and working with large codebases.
- Strong analytical and reasoning skills for evaluating correctness and side effects
- Experience with async Python (asyncio), concurrency, or performance debugging is a plus.
- Comfortable working independently in a freelance, task-based environment.
Why Join Us
- Work on high-impact projects that contribute to building AI for Good.
- Collaborate with top-tier engineers and domain experts from IITs, NITs, and BITS.
- Opportunity to grow in a fast-paced, innovation-driven environment.
NOTE: This will be a flexible freelancing opportunity. Pay will vary by project and typically is up to 1500 per hour.
