Job Description
Role Overview :
As a Principal AI Engineer at MontyCloud, you will define and drive the technical vision for agentic AI systems powering the next generation of intelligent cloud operations. This role focuses on architecting scalable, production-grade AI systems, establishing engineering standards, mentoring senior engineers, and leading strategic technical initiatives across the organization. You will work at the intersection of AI, cloud infrastructure, and autonomous operations to build systems that are reliable, observable, and capable of operating at enterprise scale.
Key Responsibilities
Technical Leadership & Architecture :
- Define and own the technical vision for agentic AI systems across the platform
- Architect scalable multi-agent systems, orchestration frameworks, MCP server infrastructure, retrieval and memory pipelines, and observability layers
- Drive architectural decisions related to MCP/ tool ecosystems, AI platform design, and LLMOps infrastructure
- Evaluate emerging AI technologies, frameworks, and models to influence engineering and product roadmaps
- Create and maintain Architecture Decision Records (ADRs) and technical & Delivery :
- Design and develop critical AI platform components and infrastructure
- Establish AI engineering best practices and discipline across the organisation - design patterns, evaluation practices, prompt engineering, reliability standards, governance, and cost optimization
- Lead cross-functional technical initiatives to improve AI system quality, reliability and scalability
- Collaborate with platform, infrastructure, and data engineering teams to embed AI-driven automation into cloud operations & Technical Community :
- Mentor Lead and Staff AI Engineers through architecture reviews, design discussions, and problem-solving sessions
- Conduct rigorous technical reviews of designs, architectures, and major code contributions
- Contribute to MontyClouds technical brand through technical writing, open-source contributions, or speaking & Strategic Impact :
- Identify opportunities where agentic AI can create significant product or operational improvements
- Build prototypes, technical proposals, and proof-of-concepts to validate new ideas
- Stay current with advancements in AI research, agentic frameworks, and LLMOps practices
Desired Skills And Requirements
Must Have :
- Agentic AI & Multi-Agent Systems :
i. Production-grade agentic AI system design and development
ii. Agentic AI System Design & Architecture - Multi-agent architectures and orchestration, Agent-to-agent communication, Agent memory and planning strategies, Tool integration and MCP server design
iii. Agent orchestration frameworks - LangGraph, CrewAI, AutoGen, Strands Agents, or equivalent agentic AI frameworks
- LLMOps & AI Platform Engineering :
i. AI Governance & Lifecycle Management - Prompt versioning and governance, evaluation frameworks, regression detection
ii. AI Observability & Monitoring - Output quality monitoring, Agent tracing and observability
iii. AI Cost Management - Cost governance for high-scale AI workloads
i. Cloud AI Platforms & Services - AWS cloud ecosystem, AWS Bedrock, AgentCore
ii. Cloud-Native Infrastructure & Deployment - Cloud-native AI deployments, Kubernetes, Docker
iii. Infrastructure as Code (IaC) - Terraform
- Foundation Models & AI Integrations :
i. Foundation model API integration - OpenAI, Anthropic, AWS Bedrock, Azure OpenAI, Hugging Face
ii. MCP and AI tool integration architecture
- RAG & Knowledge Systems :
i. Retrieval-Augmented Generation (RAG) and Graph-RAG architectures
ii. Embedding strategies, retrieval and reranking systems
iii. Knowledge graph integrations
- Technical Leadership and Communication :
i. Cross-team technical influence
ii. Technical communication and documentation
iii. Organization-level engineering ownership
iv. Proactive problem identification and resolution
Good To Have
i. AI systems for cloud operations and infrastructure automation
ii. Developer tooling platforms
- AI Deployment & Optimization :
i. Serverless AI deployment patterns
ii. AI inference cost optimization
- Advanced AI Techniques Exposure :
i. Model fine-tuning and RLHF
ii. Advanced model evaluation techniques
- Industry & Community Exposure :
i. AI-first or cloud-native product company
ii. Open-source contributions, technical blogs, conference talks, or published research in AI/agentic systems
Experience
- 12+ years of overall software engineering experience
- Prior experience in a Principal Engineer role or equivalent individual contributor (IC) role
- Significant recent hands-on experience building and deploying applied AI systems in production environments
- Proven track record of leading large-scale technical initiatives across multiple teams or product areas
- Demonstrated expertise in architecting enterprise-scale AI platforms and cloud-native AI workloads
- Experience mentoring senior engineers and influencing technical strategy at an organizational level
Education
- Bachelors or Masters degree in Computer Science / Artificial Intelligence / Machine Learning / Engineering / or any related technical discipline
- Equivalent practical experience in advanced AI system design and distributed cloud platforms may also be considered
(ref:hirist.tech)