Senior Machine Learning Engineer

Job Title: Senior Machine Learning Engineer (6+ Years Experience)

Location: Mumbai, Bengaluru

Employment Type: Full-time

Role Overview

We are looking for a Senior Machine Learning Engineer to lead the development and optimization of Small Language Models (SLMs) for enterprise clients. You will drive complex model fine-tuning, knowledge distillation. As a senior technical contributor, you will mentor junior engineers, guide model selection and GPU optimization decisions, and ensure high-quality delivery across multiple concurrent client engagements.

Key Responsibilities

Lead and execute complex fine-tuning and knowledge distillation pipelines for Small Language Models (1B-13B parameters) including Llama, Mistral, Phi, Qwen, and Gemma model families.

Architect and implement production-grade RAG systems with vector database integration for domain-specific enterprise applications.

Drive model selection decisions by evaluating performance, licensing, and deployment requirements across client use cases in FinTech, Healthcare, Insurance, and Retail verticals.

Collaborate with MLOps engineers to optimize inference performance, including quantization (INT8/INT4), latency tuning, and GPU resource utilization on AWS infrastructure (EC2, SageMaker, EKS).

Design and generate high-quality synthetic datasets for model training, addressing data privacy constraints and domain-specific requirements.

Provide technical mentorship to mid-level ML engineers guiding experimentation, reviewing code, and establishing ML best practices across the pod.

Evaluate emerging SLM architectures, fine-tuning techniques, and optimization frameworks to maintain client's competitive edge in the market.

Support pre-sales activities by contributing to technical assessments, model benchmarking, and solution design for client proposals.

Contribute to the development of pre-built domain-specific SLMs for priority verticals, enabling rapid deployment for future customers.

Stay updated on SLM research, new model releases, and fine-tuning best practices through paper reading and team knowledge sessions.

Qualifications

Engineering degree in Computer Science, Mathematics, Electrical Engineering, or related field.

6+ years of experience in applied ML, deep learning, or AI systems engineering.

Strong proficiency in Python and ML frameworks (PyTorch, TensorFlow, Hugging Face, LangChain).

Proven experience with model compression, distillation, and retrieval-augmented generation workflows.

Solid understanding of data engineering, vector databases, and modern LLM architectures.

Excellent problem-solving, collaboration, and communication skills.

Prior experience mentoring or leading junior engineers is a strong plus.