Senior System Software Engineer - Dynamo and Triton Inference Server jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 3 days ago

Senior System Software Engineer - Dynamo and Triton Inference Server

positionWashington, United States
timeFull-time
remoteOnsite
senioritySenior Level, Lead/Staff
money$184K/yr - $288K/yr
date8+ years exp

NVIDIA is a leading technology company known for its GPU-accelerated deep learning software. They are seeking a Senior System Software Engineer to develop open source software for AI model inference on GPUs, focusing on building robust and scalable software components for distributed inference workloads.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Bushra S.
linkedin

Responsibilities

Develop open source software to serve inference of trained AI models running on GPUs
Balance a variety of objectives: build robust, scalable, high performance software components to support our distributed inference workloads; work with team leads to prioritize features and capabilities; load-balance asynchronous requests across available resources; optimize prediction throughput under latency constraints; and integrate the latest open source technology

Qualification

RustPythonC++Distributed systemsMachine LearningDeep learning frameworksCloud servicesAgile environmentDebuggingPerformance analysisTest design

Required

Masters or PhD or equivalent experience
8+ years in Computer Science, Computer Engineering, or related field
Ability to work in a fast-paced, agile team environment
Excellent Rust/Python / C++ programming and software design skills, including debugging, performance analysis, and test design
Experience with high scale distributed systems and ML systems

Preferred

Prior work experience improving performance of AI inference systems
Background with deep learning algorithms and frameworks. Especially experience Large Language Models and frameworks such as PyTorch, TensorRT, and ONNX Runtime
Experience building and deploying cloud services using HTTP REST, gRPC, protobuf, JSON and related technologies
Have familiarity with the latest AI research and working knowledge of how these systems are efficiently implemented

Benefits

Equity and benefits

Company

NVIDIA

twittertwittertwitter
Glassdoor4.6
company-logo
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
dateFounded in 1993
location
Santa Clara, California, USA
people-size10001+ employees
web-link
https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin

Recent News

Business Insider
AI has been all about GPUs. That's changing fast.
2026-01-09
Business Insider
Retail trader hero Eric Jackson says investors missed the big takeaway from Jensen Huang's CES talk
2026-01-09
Inc.com
Nvidia Is Helping This Fusion Startup Reduce Years of Work to Weeks Through a ‘Digital Twin’
2026-01-09
Company data provided by crunchbase