Senior ML Engineer
- Posted 2 months ago
- Be among the first 40 applicants
Job Description
Responsibilities
- Architect and scale a next-generation multimodal inference platform powering multiple production AI pipelines.
- Building GPU-resident multimodal pipelines for image, audio, and video inference.
- Optimizing PyTorch models with TensorRT and Torch-TensorRT.
- Designing dynamic batching and low-latency inference systems.
- Building GPU-native preprocessing pipelines using NVIDIA DALI and Kornia.
- Supporting inference across heterogeneous GPU fleets (H100 A100 A10G, RTX 4090 etc. ).
- Improving observability, throughput, reliability, and deployment automation.
- Strong Python and PyTorch skills.
- Experience deploying ML models in production.
- Understanding of GPU inference optimization and CUDA fundamentals.
- Familiarity with Docker and Linux.
- Strong debugging and problem-solving skills.
- Experience with NVIDIA Triton, TensorRT, or DALI.
- Familiarity with CUDA profiling and performance optimization.
- Experience with distributed inference systems.
- Knowledge of audio/video ML pipelines.
- Experience with ONNX, AWS GPU infrastructure, and model quantization techniques (FP16/INT8).
More Info
Key Skills
About Company
Skills:
Tensorflow, Pytorch, Python, AI agent-based coding tools, Deep Neural Networks
Skills:
model selection , Typescript, Python, AI quality systems, Human labeling, Model graders, Experiment design, Statistics, Fine-tuning
Skills:
Exploratory Data Analysis (EDA), Deep learning architectures (CNNs, probability , Transformers), Tensorflow, Nosql, Pytorch, XGBoost, Python, Sql, Azure ML, Etl, Data preprocessing, Distributed training and scaling ML on large datasets, MLflow, Feature engineering, MLOps workflows, Data annotation tools, Kubeflow, Vertex AI, ML model evaluation, Scikit-learn, Statistics, RNNs, linear algebra
Skills:
Etl, Sql, Databricks, ELT, Python, Data Modelling, Spark, cloud-native data services, CI CD, warehousing concepts, containerisation, AI coding tools, GitHub Copilot, Claude Code
Skills:
Databases, API design, Distributed Systems, Python, LangChain, CrewAI, LLMs, AutoGen, backend architecture, LlamaIndex