Search by job, company or skills

AI Engineer - LLM/Agentic AI

hitya global
3-5 Years
Bengaluru, India
Early Applicant
  • Posted 17 days ago
  • Be among the first 30 applicants

Job Description

Responsibilities

  • Design and implement asynchronous multi-agent orchestration.
  • Own end-to-end latency from user message to AI response.
  • Build resilient inference pipelines that gracefully degrade under load.
  • Implement intelligent request routing and load balancing for AI workloads.
  • Migrate critical AI conversation flow from monolith to dedicated services.
  • Implement WebSocket/streaming infrastructure for real-time chat.
  • Design circuit breakers and fallback strategies for AI model failures.
  • Build comprehensive observability for AI system performance.
  • Optimise credit data retrieval and caching strategies.

Requirements

  • 3-5 years building production systems handling > 10k concurrent users.
  • Proven experience with async/event-driven architectures (not just REST APIs).
  • Hands-on experience scaling ML/AI inference in production.
  • Deep understanding of caching strategies (Redis, in-memory, CDN).
  • Experience with message queues and real-time communication protocols.
  • Built systems integrating multiple LLM/AI models in production.
  • Experience with AI model serving frameworks (TensorFlow Serving, Triton, etc.).
  • Understanding of AI inference optimisation (batching, caching, model quantisation).
  • Knowledge of conversation state management and context handling.
  • Has debugged production issues under high AI inference load.

(ref:hirist.tech)

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Ai/Ml Engineering
Employment Type:
Full time

About Company

Job ID: 152356429

Last Updated: 31-08-2026 10:16:20 PM
Homejobs in Bengaluru / BangaloreAI Engineer - LLM/Agentic AI

Similar Jobs

Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

CISCO Credit
Bengaluru, India

Skills:

S3, Lambda, Docker, Sqs, Sns, Python, Kubernetes, AWS, LLM evaluation and observability tooling, LangGraph, ETL optimization, Agentic AI LLM applications, RAG architectures

Software Engineer (Agentic AI, LLM, Python | 5 to 8 Years)

Cisco Home
Bengaluru, India

Skills:

S3, Lambda, Docker, Sqs, Sns, Kubernetes, Python, AWS, LLM evaluation and observability tooling, LangGraph, ETL optimization, Agentic AI LLM applications, RAG architectures

Beware of Scammers

We don’t charge money for job offers

Know More