Search by job, company or skills

Larsen & Toubro

AI Architect

Larsen & Toubro
Chennai, India
15-20 Years
Save
  • Posted 24 days ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Purpose

Designs and architect end-to-end AI Cloud platforms with a focus on security, cost-efficiency, and performance. This position involves direct client engagement to translate requirements into technical Solution, encompassing GPU infrastructure rightsizing and optimal model selection. We are looking for a cloud expert with a demonstrated ability to transition complex AI models from concept to large-scale production. The ideal candidate brings extensive experience in AI/Cloud ecosystems and a successful track record of architecting and managing production-grade, large-scale AI platforms.

Role Summary

Key Responsibilities

  • Translate business requirements into scalable, high-performance AI/GenAI architectures featuring NVIDIA GPU clusters
  • Design end-to-end AI Cloud and next-generation platforms optimized for deep learning workloads and distributed training.
  • Architect HPC cluster topologies utilizing high-speed InfiniBand (NDR/HDR) and RoCE v2 interconnects for low-latency communication.
  • Right-size platform components, including GPUs, CPUs, memory and NVMe storage for comprehensive client proposals.
  • Architect distributed training and inference environments optimized for MPI frameworks and workload scheduling via Slurm.
  • Desing scalable container orchestration platforms using Kubernetes and Kubeflow to manage AI workloads.
  • Propose optimized inference strategies using vLLM, Triton, and TensorRT-LLM to meet specific latency and throughput KPIs.
  • Should have experience on RAG systems and multi-agent orchestration frameworks like LangGraph and agentic ecosystems.
  • Develop private AI cloud environments focused on data sovereignty and regulatory compliance, such as the India DPDP Act.
  • Define integration strategies for LLMs and open-source models within existing enterprise data systems, APIs, and knowledge graphs.
  • Establish reference architectures for CI/CD/CT pipelines and automated model retraining workflows to ensure reproducibility.
  • Implement automation and observability frameworks for monitoring GPU utilization, performance tuning, and failure handling.
  • Drive technical validation through Proof of Concept (PoC) engagements, focusing on scalability and performance benchmarks for LLM training.
  • Establish Infrastructure-as-Code (IaC) practices to ensure reproducible and reliable cluster deployments.
  • Collaborate with C-suite stakeholders and cross-functional teams to drive technical decision-making, innovation, and roadmap alignment.

Experience & Educational Requirements

Qualifications and Experience

EDUCATIONAL QUALIFICATIONS: (degree, training, or certification required)

BE/B-Tech or equivalent with Computer Science or Electronics & Communication

RELEVANT EXPERIENCE: 15 - 20 years of IT Experience with minimum 5 years in AI platform

Required Technical Skills

Core AI/ML Expertise

  • Strong experience in Nvidia, Intel, Google GPU Architecture, InfiniBand
  • Strong expertise in Kubernetes, Slurm and OpenShift
  • Good experience in Python, PyTorch and TensorFlow
  • Good knowledge on LangChain, LangGraph
  • Deep understanding of Transformers, Attention mechanisms, Diffusion, MoE
  • Knowledge of RLHF, Pinecone, FAISS, Chroma, OpenAI, VLLM
  • Expertise in RAG and agentic AI workflows
  • Knowledge of high-performance storage (Lustre, PFS, Object NVMe)
  • Good Knowledge with NVIDIA architectures (Hopper, Blackwell)

Soft Skills

  • Strong problem-solving and analytical thinking
  • Excellent communication and stakeholder management
  • Ability to influence leadership and drive strategic decisions
  • Innovation mindset with focus on enterprise impact

Preferred Experience

  • Currently in AI / Cloud Presales team
  • Should be able to right size infra and choose right GPU model as per client requirement
  • Hands-on with Python, vector DBs (Pinecone, FAISS, Chroma), and LLM APIs (OpenAI, Anthropic).
  • Solid understanding of cloud-native architecture OpenStack, KVM, (Azure/AWS/GCP), microservices, Kubernetes, serverless, API gateways.
  • Good knowledge on deep learning experience: CNNs, RNNs/LSTMs, Transformers, and attention mechanisms.
  • Proficiency in Python for ML: NumPy, pandas, scikit-learn, and frameworks such as PyTorch or TensorFlow.
  • Experience in integrating LLMs (GPT, Claude, Gemini, LLaMA, Mistral) into applications.
  • Prompt engineering skills: zero-shot, few-shot, chain-of-thought, ReAct, and structured output patterns.
  • Experience building RAG systems: document chunking, embedding models, vector search, and retrieval optimization.
  • Understanding of AI agent patterns, tool use, and agentic workflows.
  • Familiarity with Docker, CI/CD pipelines, and Git-based workflows.
  • Strong communication, stakeholder management, and solution design skills.

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Ai Cloud
Employment Type:
Full time

About Company

Larsen & Toubro

Job ID: 148279311

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 10-06-2026 11:58:13 AM
Homejobs in ChennaiAI Architect

Similar Jobs

AI Architect - Databricks

Unison Group New Zealand
Chennai, India

Skills:

data engineering , Distributed Computing, Machine Learning, Pyspark, ELT, Python, AWS, Sql, Gcp, MLops, Databricks, Azure, Etl, embeddings, Hugging Face, MLflow, Cloud-based AI solutions, Lakehouse architecture, Databricks ecosystem, Databricks Workflows, RAG architectures, LangChain, Generative AI, LLMOps, Feature Store, Model Serving, Unity Catalog, vector stores, Delta Lake, OpenAI

Agentic AI Architect

kyndryl india
Chennai, India

Skills:

AWS, Azure, Gcp, tool orchestration, LlamaIndex, knowledge graph integration, multi-agent systems, agentic AI architectures, cloud-native AI platforms, Hugging Face, AutoGen, RAG, LangChain, Prompt Flow, autonomous agent design patterns, CrewAI, Azure AI Studio, LLM orchestration, AI ML development, autonomous orchestration solutions

Senior Architect - AI & ML

hd supply global technology center
Chennai, India

Skills:

Apache Spark, Kafka, Tensorflow, Pytorch, Gcp, MLops, Azure, AWS, Airflow, Hugging Face, MLflow, DataOps, CI CD pipelines, Kubeflow, Delta Lake

Sr. Software Architect-AI

Ericsson
Chennai, India

Skills:

Tensorflow, Pytorch, Docker, Terraform, Python, MLops, FastAPI, Kubernetes, embeddings, AWS Bedrock, vector databases, Pinecone, Azure OpenAI, Elastic, LangGraph, Chroma, LLM architectures, RAG pipelines, fine-tuning techniques, DL frameworks, LangChain, PEFT, LLMOps, AutoGen, asyncio, LoRA, Milvus, LlamaIndex

Architect / Sr. Architect – GenAI & AI Platforms (Data and AI)

Tiger Analytics
Chennai, Bengaluru

Skills:

Apis, Backend Development, Django, MLops, Gcp, Flask, Distributed Systems, Azure, Kubernetes, AWS, Python frameworks, Generative AI, LLMs, MLE, Microservices architecture, Cloud-native architectures, Agentic AI, Cloud-based deployment strategies