About Us:
Deccan AI Experts is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Based in SF and Hyderabad, we are a young, fast-moving team on a mission to build AI for Good, driving innovation and positive societal impact.
About the Job
We are looking for a skilled RAG & Agentic AI Evaluation Engineer (Freelancer) to join our team and improve the performance, reliability, and quality of advanced AI systems. If you're passionate about evaluating AI outputs, testing RAG systems, and solving real-world machine learning challenges, this is the role for you.
Key Responsibilities:
- Create deliverables addressing common requests within RAG, LLM, and Agentic AI systems.
- Review peer-developed deliverables to enhance AI research and improve model quality.
- Diagnose and solve real-world issues in retrieval systems, prompt workflows, and AI agent performance.
- Contribute expertise to cutting-edge AI research while working independently and remotely.
- Manage your own schedule with flexible hours to meet project deadlines.
- Evaluate model outputs, prompt quality, retrieval accuracy, and system reliability.
Required Qualifications:
- 2+ years of hands-on experience in AI evaluation, machine learning, NLP, or related roles.
- Strong understanding of RAG systems, LLMs, prompt engineering, and AI agent workflows.
- Experience in model evaluation, testing frameworks, and quality assurance for AI systems.
- Proficiency in tools like Python, Jupyter Notebook, Git, and vector database platforms or similar tools.
- Strong analytical, problem-solving, and communication skills.
Why Join Us
- Competitive pay (₹1200/hour).
- Flexible hours.
- Remote opportunity.
