Job Profile: Senior Software Development Engineer in Test (AI Ops)
Years of Experience: 4 - 6
Location: Bangalore
Position Overview
Senior Software Development Engineer in Test (AI Ops) is a technical individual contributor role at Swiggy. In this role, you will design and implement test automation strategies that ensure the reliability, scalability, and efficiency of AI-powered systems. You will work across both traditional QA automation and AI operations, building evaluation pipelines, observability dashboards, and cost-performance guardrails.
This role is best suited for someone who thrives at the intersection of testing, automation, and applied AI, ensuring every AI-driven feature delivers reliable, measurable impact at scale.
What Qualities Are We Looking For
- 46 years of experience in Automation Testing and QA strategy.
- Strong understanding of databases (MySQL, SQL Server, Oracle) and experience writing optimized queries.
- Proficiency in Java-based test automation, including frameworks such as TestNG, Maven, or Gradle
- Familiarity with backend & frontend technologies like Spring Boot, Node.js, or Golang along with modern CI/CD systems.
- Solid grasp of design patterns and experience defining functional and non-functional test strategies.
- Experience working with cloud and distributed systems.
- Hands-on experience testing and monitoring AI or data-driven systems, including LLMs, RAG pipelines & vector databases.
- Ability to build observability dashboards for AI workflows (latency, accuracy, cost tracking).
- Exposure to AI evaluation tools & frameworks (TruLens, OpenEval) & familiarity with the AI ecosystem (Azure OpenAI, LangChain, Pinecone).
What Will You Get To Do Here
- Extend automation frameworks used across Swiggy QA teams for backend, frontend, and AI workflows.
- Build test data pipelines & automated evaluation systems for AI-driven features (Desk agents, recommendation systems).
- Partner with AI platform & product teams to define measurable evaluation criteria & feedback loops for model performance.
- Create monitoring systems that flag cost or accuracy drifts across AI-driven features.
- Contribute to the definition and rollout of AI reliability metrics for production systems.
- Lead root-cause analysis of production incidents involving AI or automation failures.
- Mentor QA engineers and collaborate cross-functionally to uphold quality standards across all releases.
- Work on continuous improvement of automation ROI through smart coverage, test optimization & early issue detection.
Visit our tech blogs to learn more about some of the challenges we deal with:
- https://bytes.swiggy.com/the-swiggy-delivery-challenge-part-one-6a2abb4f82f6
- https://bytes.swiggy.com/swiggy-distance-service-9868dcf613f4
- https://bytes.swiggy.com/the-tech-that-brings-you-your-food-1a7926229886
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, disability status, or any other characteristic protected by the law.
