
Search by job, company or skills
Role: Principal AI Architect
Function: Engineering - AI/ML
Location: Navi Mumbai, Bangalore
Type: Full-time
Industry: AI/ML, Consumer Technology
About Company
A venture-backed AI company building the intelligence layer for India at massive scale. Backed by partnerships with global tech leaders like Meta and Google.
The company creates AI that serves the entire Indian user base across languages, contexts, and daily needs. Engineered from day one for 100M+ users early and 1B-ready constraints on latency, cost, reliability, and safety.
Position Overview
You will define the architecture and technical direction for an AI platform serving 100M+ users across India. You'll lead multiple technical teams spanning AI infrastructure, model orchestration, and vector knowledge systems while driving hands-on technical excellence. This role offers direct ownership of distributed AI/ML services that power real-world consumer experiences at unprecedented scale.
Role & Responsibilities
Define and drive the technical architecture for AI orchestration platform serving 100M+ users
Lead multiple engineering teams across AI infrastructure, model orchestration, and vector systems
Design and implement distributed AI/ML services with focus on latency, cost, and reliability
Build hands-on solutions for LLM orchestration, model routing, and multi-agent coordination systems
Establish technical standards and best practices for GenAI platform development
Drive architecture decisions for cloud-native AI infrastructure and observability systems
Own end-to-end GenAI solutions from prototype to production-scale deployment
Must Have Criteria
10+ years of experience in AI/ML distributed systems and AI/ML platform engineering
Hands-on experience building and owning GenAI solutions in production
Deep expertise with AI Agents, LLM orchestration, model routing, LangChain/LlamaIndex, VectorDBs, and RAG
Strong experience with AI/ML orchestration frameworks and embeddings systems
Proven leadership experience driving architecture decisions at scale
Experience with Azure DevOps and GCP cloud-native stacks including Kubernetes, Kafka, and Terraform
Demonstrated ability to build distributed AI/ML services with high reliability
Nice to Have
Experience building AI platforms for consumer-scale applications (100M+ users)
Background in multi-modal and multi-lingual AI systems
Previous experience in startup or high-growth technology environments
Open source contributions to AI/ML orchestration or infrastructure projects
What We Offer
Opportunity to build AI infrastructure for 100M+ users across India
Leadership role in a fast-moving, high-ambition AI team
Direct impact on category-defining consumer AI experience
Collaboration with global tech partners like Meta and Google
Competitive compensation and equity in a high-growth AI company
Job ID: 144181539