CUDA Kernel Engineer
CUDA Kernel Engineer
Nava- Posted 2 months ago
- Be among the first 10 applicants
Job Description
Role & Responsibilities
Must-Have
- Design, write, and optimize high-performance CUDA kernels targeting NVIDIA Ampere, Hopper, and upcoming architectures.
- Profile and debug GPU memory bandwidth, occupancy, and instruction-level bottlenecks using Nsight Compute, Visual Profiler, and custom instrumentation.
- Collaborate with ML and HPC teams to translate algorithmic requirements into efficient, scalable, and portable GPU code.
- Implement fused operations, shared memory optimizations, and warp-level primitives to maximize throughput under latency and memory constraints.
- Contribute to kernel library development and maintain reusable, well-documented, and performance-tested modules.
- Stay ahead of evolving CUDA toolchains, compiler flags, and architecture-specific features to continuously extract performance wins.
Must-Have
- CUDA C++
- Nsight Compute
- NVIDIA GPU Architecture (Ampere/Hopper)
- GPU Memory Hierarchy Optimization
- Warp-Level Primitives
- Profiling & Performance Tuning
- nvcc Compiler
- PTX / SASS Assembly (Basic Understanding)
- Experience with Tensor Cores and FP8/FP16 kernels
- familiarity with cuDNN, cuBLAS, or CUTLASS
- Contributions to open-source GPU compute projects
More Info
Key Skills
NVIDIA GPU Architecture Ampere Hopper
PTX SASS Assembly Basic Understanding
CUTLASS
Nsight Compute
nvcc Compiler
FP8 FP16 kernels
cuBLAS
Warp-Level Primitives
Tensor Cores
GPU Memory Hierarchy Optimization
cuDNN
Profiling Performance Tuning
About Company