Search by job, company or skills

Fractal

Senior QA (Gen AI - Must have) Exp: 5+ Years

Save
new job description bg glownew job description bg glow
  • Posted an hour ago
  • Be among the first 10 applicants
Early Applicant

Job Description

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Role: Senior QA (Gen AI - Must Have)

Experience: 5+ Years

Detailed JD

  • Design, automate, and execute API test suites (functional, contract, performance, resilience)
  • Define LLM evaluation strategies (performance testing, golden sets, guardrails, hallucination/consistency checks, relevance & latency KPIs); build automated eval pipelines tied to releases.
  • Create PDLM deliverables: verification plans/protocols, test reports, risk-based coverage, V&V trace matrices to requirements and use cases.
  • Integrate test infrastructure with Azure DevOps (CI/CD, test orchestration, quality gates, dashboards); enforce build-time gates for API and LLM quality.
  • Partner with Product, Clinical, and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.

What is required from candidate

  • 5+ years in backend/API test automation (REST, JSON, auth), performance testing, and CI/CD.
  • Hands-on with Python/TypeScript, Postman/Newman or REST-assured, PyTest/Jest, k6/JMeter, Docker.
  • Experience validating ML/LLM systems (eval datasets, metrics, prompt/response testing, safety/guardrails).
  • Strong documentation and traceability discipline for regulated product lifecycles (PDLM/QMS).
  • Bonus: Azure DevOps pipelines, FHIR/HL7 familiarity, healthcare data privacy/security.
  • Bonus: Frontend testing capabilities are preferred, but not part of the PDLM requirements.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Hiring Related Queries

India: [Confidential Information]

Outside India: [HIDDEN TEXT]

Please share resume via job postings

Not the right fit Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!





More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 147542147