SDET - III (RAGas Automation Testing)

5-7 Years

Job Description

Requirements

Experience: 5+ years in software testing or automation for web applications, SaaS platforms, or large-scale systems
Technical Depth: Proven expertise in designing and maintaining test automation frameworks (Playwright, Cypress, Selenium, etc.)
Programming Skills: Strong in TypeScript, JavaScript, or Python — capable of writing scalable, maintainable automation code
MUST HAVE : RAG Testing and AI Product Testing, RAG Architecture, Retrieval Testing, Prompt Engineering Testing
Infrastructure Knowledge: Hands-on experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab) and containerized environments (Docker, Kubernetes)
Cloud Proficiency: Working knowledge of GCP or AWS for test infrastructure and environment setup
API & Backend Testing: Deep understanding of RESTful APIs, request validation, and integration testing
Observability & Reporting: Familiarity with test reporting dashboards, metrics tracking, and alerting (Grafana, Prometheus, Slack integrations)
Debugging Skills: Strong ability to diagnose failures in distributed systems and identify root causes quickly
Architecture Awareness: Solid understanding of system design, micro-services, databases, and data flow across layers
Soft Skills: Excellent communication, documentation, and collaboration skills with a cross-functional mindset
Mindset: Ownership-driven, curious about platform scalability, and passionate about building tools that enable others to test better

Responsibilities

Own and evolve the test automation platform, ensuring scalability, reliability, and ease of use
Design and maintain robust automation frameworks across UI, API, and backend layers
Build and enhance internal QA tools that improve test efficiency
Drive adoption of automation best practices, coding standards, and efficient test design
Implement and maintain test observability systems for reporting, analytics, and defect insights
Conduct performance, load, and scalability testing for key features and services
Develop and maintain test infrastructure, supporting containerized and distributed environments
Collaborate closely with developers, QA, and DevOps to embed quality throughout the delivery pipeline
Improve test reliability and flakiness detection through intelligent retry and failure analysis systems
Contribute to continuous improvement of tooling, test data management, and CI/CD quality gates
Research and implement emerging technologies (AI/ML, LLMs, smart test generation, etc.) to advance test automation capabilities
Advocate for shift-left quality, influencing design and architecture discussions for better testability
Maintain clear documentation and onboarding materials for test frameworks and platform usage

Skills: llm testing,ragas,ai test engineer,retrieval testing,prompt engineering,rag evaluation,python,javascript