NVIDIA · 12 hours ago
Senior Deep Learning Software Engineer, Inference and Model Optimization
Santa Clara, CA
Full-time
Onsite
Senior Level
$184K/yr - $288K/yr
5+ years expNVIDIA is at the forefront of the generative AI revolution, focusing on optimizing AI models for maximal inference efficiency. They are seeking a Senior Deep Learning Software Engineer to develop and scale automated inference and deployment solutions, working with cutting-edge generative AI models and high-performance kernel implementations.
AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
Responsibilities
Train, develop, and deploy state-of-the generative AI models like LLMs and diffusion models using NVIDIA's AI software stack
Leverage and build upon the torch 2.0 ecosystem (TorchDynamo, torch.export, torch.compile, etc...) to analyze and extract standardized model graph representation from arbitrary torch models for our automated deployment solution
Develop high-performance optimization techniques for inference, such as automated model sharding techniques (e.g. tensor parallelism, sequence parallelism), efficient attention kernels with kv-caching, and more
Collaborate with teams across NVIDIA to use performant kernel implementations within our automated deployment solution
Analyze and profile GPU kernel-level performance to identify hardware and software optimization opportunities
Continuously innovate on the inference performance to ensure NVIDIA's inference software solutions (TRT, TRT-LLM, TRT Model Optimizer) can maintain and increase its leadership in the market
Play a pivotal role in architecting and designing a modular and scalable software platform to provide an excellent user experience with broad model support and optimization techniques to increase adoption
Qualification
Required
Masters, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field
5+ years of relevant work or research experience in Deep Learning
Excellent software design skills, including debugging, performance analysis, and test design
Strong proficiency in Python, PyTorch, and related ML tools (e.g. HuggingFace)
Strong algorithms and programming fundamentals
Good written and verbal communication skills and the ability to work independently and collaboratively in a fast-paced environment
Preferred
Contributions to PyTorch, JAX, or other Machine Learning Frameworks
Knowledge of GPU architecture and compilation stack, and capability of understanding and debugging end-to-end performance
Familiarity with NVIDIA's deep learning SDKs such as TensorRT
Prior experience in writing high-performance GPU kernels for machine learning workloads in frameworks such as CUDA, CUTLASS, or Triton
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
Tech Startups - Tech News, Tech Trends & Startup Funding
2026-01-22
Dynamic Business
2026-01-22
2026-01-22
Company data provided by crunchbase