Senior System Software Engineer - Dynamo and Triton Inference Server jobs in United States
info-icon
This job has closed.
company-logo

NVIDIA · 1 day ago

Senior System Software Engineer - Dynamo and Triton Inference Server

positionCalifornia, United States
timeFull-time
remoteOnsite
senioritySenior Level, Lead/Staff
money$184K/yr - $288K/yr
date8+ years exp

NVIDIA is hiring a Senior System Software Engineer to work on Dynamo & Triton Inference Server. The role involves developing software for AI model inference on GPUs and optimizing performance for distributed workloads.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Develop open source software to serve inference of trained AI models running on GPUs
Build robust, scalable, high performance software components to support our distributed inference workloads
Work with team leads to prioritize features and capabilities
Load-balance asynchronous requests across available resources
Optimize prediction throughput under latency constraints
Integrate the latest open source technology

Qualification

RustPythonC++Distributed systemsDeep learning frameworksCloud servicesAgile team environmentPerformance analysisTest design

Required

Masters or PhD or equivalent experience
8+ years in Computer Science, Computer Engineering, or related field
Ability to work in a fast-paced, agile team environment
Excellent Rust/Python / C++ programming and software design skills, including debugging, performance analysis, and test design
Experience with high scale distributed systems and ML systems

Preferred

Prior work experience improving performance of AI inference systems
Background with deep learning algorithms and frameworks. Especially experience Large Language Models and frameworks such as PyTorch, TensorRT, and ONNX Runtime
Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies
Have familiarity with the latest AI research and working knowledge of how these systems are efficiently implemented

Benefits

Equity
Benefits

Company

NVIDIA

twittertwittertwitter
Glassdoor4.6
company-logo
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
dateFounded in 1993
location
Santa Clara, California, USA
people-size10001+ employees
web-link
https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin

Recent News

Business Insider
AI has been all about GPUs. That's changing fast.
2026-01-09
Business Insider
Retail trader hero Eric Jackson says investors missed the big takeaway from Jensen Huang's CES talk
2026-01-09
Inc.com
Nvidia Is Helping This Fusion Startup Reduce Years of Work to Weeks Through a ‘Digital Twin’
2026-01-09
Company data provided by crunchbase