Jax, Linux System Administration, Bash, Cuda, Pytorch, Docker, Kubernetes, Python, TensorRT-LLM, inference benchmarking, RDMA, infiniband, Hugging Face Transformers, GPUDirect, Go, high-performance networking technologies, SGLang, vLLM, AI model training, performance characterization, NCCL, AI ML frameworks

Distributed Systems, Python, Kubernetes, Golang, TensorRT-LLM, llm-d, AI Inference, SGLang, vLLM, GRPC

Keras, Tensorflow, Jax, Pytorch, Python, compiler optimization passes, vLLM, Pathways, SG Lang, ML compilers, GPUs, ML performance engineering, TPUs, ML frameworks, ML Inference frameworks, accelerator HW architectures