Generative AI Engineer

Job Title:

Senior QA Engineer – Backend, API & GenAI Testing

Experience:8–12 years

Location: Pune

Role Overview:

We are looking for a highly skilled and detail-oriented Senior QA Engineer with deep expertise in API Testing, Backend Validation, UI Testing, and strong exposure to GenAI-based systems. The ideal candidate should be capable of owning end-to-end QA strategy, driving automation, and ensuring high-quality delivery across complex, scalable applications.

Key Responsibilities:

• Lead end-to-end QA strategy for backend systems, APIs, and UI layers
• Design, develop, and execute robust test cases for RESTful APIs and microservices
• Validate data integrity, business logic, and system integrations across backend services
• Perform UI testing (manual + automation) for web applications
• Build and maintain automation frameworks for API and UI testing
• Work closely with developers, product teams, and architects to ensure quality at every stage
• Conduct performance, regression, and integration testing
• Identify, log, and track defects with strong debugging and root cause analysis
• GenAI Testing Responsibilities:
• Validate LLM-based applications for accuracy, consistency, and response quality
• Design test scenarios for prompt engineering, hallucination detection, and edge cases
• Evaluate model outputs, bias, safety, and reliability
• Work with GenAI pipelines including RAG (Retrieval-Augmented Generation) systems
• Ensure quality across AI workflows, embeddings, and vector databases

Required Skills:

Core QA & Backend Testing:

• Strong expertise in API Testing using tools like Postman, RestAssured
• Deep understanding of REST APIs, JSON, HTTP protocols
• Experience in microservices architecture testing
• Strong knowledge of SQL / database validation

Automation:

• Hands-on experience in test automation frameworks (Selenium, Playwright, Cypress)
• Experience with API automation and CI/CD integration

UI Testing:

• Strong experience in functional and regression testing for UI applications
• Exposure to cross-browser and responsive testing

GenAI / AI Testing:

• Hands-on experience or strong understanding of GenAI / LLM-based applications
• Familiarity with OpenAI, LangChain, vector DBs (Pinecone, FAISS, etc.)
• Experience in testing AI outputs, prompt validation, and evaluation frameworks