NVIDIA · 2 weeks ago
Senior Software Engineer, CUDA Deep Learning Systems
United States
Full-time
Remote
Senior Level, Lead/Staff
$184K/yr - $288K/yr
8+ years expNVIDIA is a leading technology company specializing in AI and deep learning. They are seeking an experienced software professional to work on innovative projects that enhance the performance of deep learning systems using CUDA, focusing on model optimization and custom kernel development.
Artificial Intelligence (AI)TransportationCloud ComputingEmbedded SoftwareGamingHardwareQuantum ComputingSemiconductorAI InfrastructureAutonomous VehiclesEmbedded SystemsFoundational AI
Responsibilities
Explore, research, and prototype novel systems optimizations for advanced deep learning models at the intersection of high-level DL frameworks and low-level CUDA through modeling, simulation, and silicon prototyping
Architect and optimize distributed computing systems that scale seamlessly from a single node to massive, cluster-scale supercomputing environments
Design, implement, and optimize custom high-performance CUDA kernels tailored to emerging neural network architectures and workloads
Analyze complex hardware-software interactions to identify and resolve performance bottlenecks in both training and inference pipelines
Collaborate closely with AI researchers, HW and SW architects, kernel and compiler authors and CUDA driver experts to co-design systems and algorithms that improve accelerator compute utilization, memory bandwidth, cross-node network communication efficiency and programmability
Develop exploratory tools and runtime systems to profile and accelerate new paradigms in deep learning
Write clean, effective, and maintainable code, ensuring exploratory prototypes can smoothly transition into open-source releases, upstream framework integrations, internal tools, or closed-source commercial products
Qualification
Required
BS, MS, or PhD degree in Computer Science, Computer Engineering, Electrical Engineering, or related field (or equivalent experience)
8+ years of relevant industry experience or equivalent academic experience after degree achievement
Strong proficiency in C++ and Python programming
Solid background in the fundamentals of Deep Learning with a focus on transformers
Strong understanding of distributed computing principles, multi-node scaling, and the unique performance challenges of cluster-scale execution
Proven experience in systems programming, computer architecture, and low-level systems performance optimization
Familiarity with deep learning accelerator architectures such as the GPU and hands-on experience with CUDA programming and kernel optimization
A strong analytical approach with experience using profiling tools to deeply understand software performance on hardware
Experience profiling and optimizing innovative vision models, generative AI architectures, or diffusion models
Background in deep learning compilers, both graph-level and codegen (e.g., Triton, XLA, torch compile)
Preferred
Deep expertise in the performance internals and execution graphs of major deep learning autograd, training and inference frameworks (e.g., PyTorch, JAX, TensorRT, vLLM, sgLang, Nemo, Megatron, MaxText, etc.)
Hands-on experience with CUDA, communication libraries (e.g., NCCL, MPI, UCX) and distributed machine learning techniques (e.g., pipeline parallelism, tensor parallelism)
Knowledge of numerical methods, low-precision arithmetic (e.g., NVFP4, MXFP4, FP8, INT8), and their implications on deep learning model accuracy and performance
Familiarity with systems requirements for Reinforcement Learning (RL) or highly parallel simulation environments and/or research background in machine learning systems or adjacent fields
Experience with machine learning, especially agentic systems, applied to systems problems
Benefits
You will also be eligible for equity and [benefits](https://www.nvidia.com/en-us/benefits/).
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
89%
Represents job field similar to this job
Engineering and Development
Management and Executive
Product Management
Marketing
Sales
Accounting and Finance
Customer Service and Support
Creatives and Design
Human Resources
Arts and Entertainment
Legal and Compliance
Trends of Total Sponsorships
*2026 (1247)
2025 (1868)
2024 (1353)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$29.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2026-06-15Post Ipo Debt· $25B
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-07-17
2026-07-17
2026-07-17
Company data provided by crunchbase