Search by job, company or skills

Coupa Software

AI Engineer, Evaluation - 11319

Coupa Software
Indi, Bengaluru
3-5 Years
Save
  • Posted a month ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Coupa makes margins multiply through its community-generated AI and industry-leading total spend management platform for businesses large and small. Coupa AI is informed by trillions of dollars of direct and indirect spend data across a global network of 10M+ buyers and suppliers. We empower you with the ability to predict, prescribe, and automate smarter, more profitable business decisions to improve operating margins.

Why join Coupa

🹠Pioneering Technology: At Coupa, we're at the forefront of innovation, leveraging the latest technology to empower our customers with greater efficiency and visibility in their spend.
🹠Collaborative Culture: We value collaboration and teamwork, and our culture is driven by transparency, openness, and a shared commitment to excellence.
🹠Global Impact: Join a company where your work has a global, measurable impact on our clients, the business, and each other.

Learn more on blog and hear from our employees about their experiences working at Coupa.

The Impact of a AI Engineer, Evaluation & Quality at Coupa:
Coupa's AI platform serves thousands of enterprise customers, and model quality directly impacts business outcomes. The AI Engineer, Evaluation & Quality will build the evaluation infrastructure that ensures our AI models meet rigorous accuracy standards. You will design benchmarks, implement automated evaluation pipelines, and build dashboards that track model performance across iterations.

What You'll Do

  • Build and maintain automated evaluation pipelines for AI model quality.
  • Implement task-specific benchmarks and test suites.
  • Design quality dashboards tracking accuracy, regression, and safety metrics.
  • Implement automated regression testing for every model iteration.
  • Build comparison frameworks for side-by-side evaluation of model variants.
  • Analyze evaluation results to identify failure modes and report to the ML team.
  • Maintain evaluation datasets: versioning, quality validation, coverage analysis.
  • Support A/B testing infrastructure for production model validation.

What You Will Bring to Coupa

  • 3+ years of software engineering
  • Proficiency in Python .
  • Experience with statistical analysis and data visualization.
  • Understanding of ML model evaluation concepts (precision, recall, F1, human eval).
  • Experience building automated test frameworks and CI/CD pipelines.
  • Familiarity with dashboarding tools.
  • Strong analytical and problem-solving skills.
  • BS in Computer Science, Statistics, or equivalent experience.
Coupa complies with relevant laws and regulations regarding equal opportunity and offers a welcoming and inclusive work environment. Decisions related to hiring, compensation, training, or evaluating performance are made fairly, and we provide equal employment opportunities to all qualified candidates and employees.

Please be advised that inquiries or resumes from recruiters will not be accepted.

By submitting your application, you acknowledge that you have read and understand that Coupa receives/collects your application, including your personal data, for the purposes of managing Coupa's ongoing recruitment and placement activities, including for employment purposes in the event of a successful application and for notification of future job opportunities if you did not succeed the first time. You will find more details about how your application is processed, the purposes of processing, and how long we retain your application in our Privacy Policy.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

More Info

Job Type:
Permanent Job
Industry:
Education/Training
Function:
Ai Engineering
Employment Type:
Full time

About Company

Coupa Software

Coupa Software is a global technology platform for Business Spend Management. The company is headquartered in San Mateo, California with offices throughout Europe, Latin America, and Asia Pacific. Coupa helps companies gain visibility into, and control over, the money and resources spent within their organizations.

Job ID: 147059705

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 18-05-2026 09:07:46 PM
Homejobs in IndiAI Engineer, Evaluation - 11319

Similar Jobs

IN_Associate_AI Engineer_GCC_Advisory_Bangalore

PwC India
Bengaluru, India

Skills:

Git, Testing, LangChain, Prompt engineering and LLM optimization techniques, Advanced Python programming, Implementing RAG pipelines, Vector databases and embedding models, Development frameworks and tools

Generative AI Engineer

karma group global
Bengaluru, India

Skills:

runway , Python, DaVinci Resolve, GPT-4o, Firefly, Sora, Adobe Premiere Pro, Kling, Hailuo, ComfyUI, Pika, Ideogram, Replicate, Adobe After Effects, Midjourney, Gemini, Stable Diffusion

AI Engineer Lead - AI Platform (India)

genios ai
Bengaluru, India

Skills:

Apis, Microservices, Pytorch, FastAPI, Python, LangChain, embeddings, Hugging Face Transformers, reranking models, retrieval design, Anthropic APIs, context engineering, prompt orchestration, LlamaIndex, RAG architectures

Senior AI Engineer

Nokia
N
Bengaluru, India

Skills:

secure coding , Argo, Solid Principles, Gcp, MLops, Sonarqube, Azure, Kubernetes, Python, AWS, CrewAI, Airflow, mypy, Static Analysis, MLflow, Bandit, LangGraph, AutoGen, ruff, Kubeflow, LlamaIndex

AI Engineer

Kpmg Services
Bengaluru, India

Skills:

Django, Git, Gcp, Docker, Flask, FastAPI, Restful Apis, Azure, Kubernetes, Python, AWS, LangChain, vector databases, AutoGen, microservices architecture, LlamaIndex