Staff Engineer- Agent Platform

We, at ThoughtSpot, are looking for a Staff Engineer for the Agentic Platform team within Spotter.

What is Spotter

ThoughtSpot was started with the mission of making the world more fact-driven by empowering any business professional to ask ad-hoc questions of their data without any technical skill. This mission has been realized by building foundational systems and expertise in NLP, distributed systems, analytical databases, relevance models, personalization, and more recently Generative AI, over a decade. Spotter is the AI analyst that hundreds of Fortune 500 businesses depend on.

AI is the new BI and the Spotter Engineering team is at the forefront. This team has created the Data Analytics product most differentiated on AI and Natural Language. Our AI infrastructure includes distributed tries, graphs, indexes, data models, logs, and events deployed across more than fifty microservices built to scale for billions of data points.

The Role You will be a Staff Engineer in the Agentic Platform team, responsible for building the foundational infrastructure that powers our next-generation AI agents. You will have the opportunity to architect platforms that orchestrate complex workflows, enabling millions of business people to make smarter decisions through advanced AI reasoning and automation.

What you will do (Responsibilities)

• Build and Manage AI Platform: Architect and implement a robust AI platform, including LLM gateways and infrastructure for AI agents capable of orchestrating complex workflows and conversational interfaces.
• Model Orchestration: Develop capabilities to dynamically configure and switch between specialized models optimized for different tasks such as reasoning, thinking, and coding to ensure optimal performance and cost-efficiency.
• Advanced Observability: Design and build comprehensive observability solutions using the latest frameworks (such as Langfuse) to provide deep visibility into agent performance, traces, and interactions.
• Benchmarking & Evaluation: Build rigorous benchmarking frameworks for AI applications to systematically evaluate model performance, latency, and quality across various use cases.
• Accuracy & Drift Monitoring: Design and implement data pipelines to collect production data and assess drifts in the accuracy of AI applications, ensuring high reliability and trust in our AI agents.
• System Scale & Reliability: Design, develop, test, maintain, monitor, and improve distributed systems and platform infrastructure to enable high-velocity iteration.
• Technical Leadership: Bring technical thought leadership to advance ThoughtSpot's differentiation and market leadership in democratizing data analytics for business users.

Required skills and qualifications

• Education: Master's/PhD degree in Computer Science, Machine Learning, Data Science, or a related field.
• Experience: Have 10+ years of experience designing and implementing consumer-grade AI applications or distributed platforms. You understand what it takes to write software that is used by millions of people.
• AI Platforms & Agents: Proven track record of building AI platforms, specifically LLM gateways, and experience with agentic architectures (e.g., LangChain, AutoGPT concepts, or custom orchestrators).
• Observability: Hands-on experience with modern AI observability stacks (e.g., Langfuse, Arize, or custom solutions) for monitoring LLM behavior in production.
• Evaluation Frameworks: Experience building and maintaining benchmarking frameworks to evaluate the quality and performance of Generative AI applications.
• Data Engineering: Ability to build data pipelines for logging, evaluation datasets, and drift detection.
• Coding Proficiency: Strong coding skills in one of the modern languages such as C++, Go, Java, or Python.
• System Design: Experience with complex, high-volume distributed systems and an understanding of how to scale AI/ML infrastructure.

About ThoughtSpot With ThoughtSpot's next-generation Search & AI-driven analytics platform, business people can type a simple Google-like search in natural language to instantly analyze billions of rows of data, and leverage artificial intelligence to get trusted, relevant insights (at the speed of thought!) pushed to them as answers to thousands of questions they might not have thought to ask. ThoughtSpot is simple enough for any business person to use, yet powerful enough to handle even the largest, most complex enterprise data without sacrificing speed, security, or governance.

At ThoughtSpot, we solve some of the hardest, most challenging problems in technology. The kind of problems we solve require diverse perspectives and the team spirit to see those differences as opportunities rather than roadblocks. It's why diversity isn't a box to check; it's the heart of Selfless Excellence, our core value we live every day. To make our dent in the universe, we seek employees with unique identities, backgrounds, and perspectives who want to build an inclusive, respectful company culture, and truly challenge the status quo.