NVIDIA · 2 days ago
Senior Deep Learning Software Engineer
Redmond, WA
Full-time
Hybrid
Senior Level, Lead/Staff
$224K/yr - $356K/yr
8+ years expNVIDIA is widely recognized as the AI computing company and is seeking a Senior Deep Learning Software Engineer to design and build their automated inference and deployment solution. The role involves defining scalable architecture for deep learning inference, optimizing GPU performance, and collaborating across teams to enhance NVIDIA's software solutions.
AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
Hiring Manager
Khai N.
Responsibilities
Play a pivotal role in defining of a modular, scalable platform to seamlessly bridge training and deployment workflows—enabling tight integration of deployment tooling with training frameworks such as Megatron and Nemo
Leverage and build upon the torch 2.0 ecosystem (TorchDynamo, torch.export, torch.compile, etc...) to analyze and extract standardized model graph representation from arbitrary torch models for our automated deployment solution
Develop support for inference optimization techniques such as speculative decoding and LoRA
Collaborate with teams across NVIDIA to use performant kernel implementations within the automated deployment solution
Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities
Continuously innovate on the inference performance to ensure NVIDIA's inference software solutions (TRT, TRT-LLM, TRT Model Optimizer) can maintain and increase its leadership in the market
Qualification
Required
Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field
8+ years of relevant work or research experience in Deep Learning
Excellent software design skills, including debugging, performance analysis, and test design
Strong proficiency in Python, PyTorch, and related ML tools
Strong algorithms and programming fundamentals
Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment
Preferred
Contributions to PyTorch, JAX, or other Machine Learning Frameworks
Knowledge of GPU architecture and compilation stack, and capability of understanding and debugging end-to-end performance
Familiarity with NVIDIA's deep learning SDKs such as TensorRT
Prior experience in writing high-performance GPU kernels for machine learning workloads in frameworks such as CUDA, CUTLASS, or Triton
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-01-25
Unified Communications fuel big enterprise success | CIO
2026-01-25
2026-01-25
Company data provided by crunchbase