Senior System Software Engineer – Dynamo Tools jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 4 hours ago

Senior System Software Engineer – Dynamo Tools

NVIDIA is a leading technology company seeking a Senior System Software Engineer to advance the AI-Perf analysis framework for benchmarking and experimentation of AI models. The role involves designing and developing scalable performance tooling while collaborating with AI researchers and engineers to deliver insights for production users.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Lead the design, development, and roadmap of AI-Perf, defining benchmarking methodologies, performance metrics, and reproducible experimental workflows
Build scalable and high-performance features to measure latency, throughput, and efficiency across AI models and distributed systems
Partner with AI researchers, platform teams, and engineers to translate experimental challenges into robust, user-friendly performance tooling
Integrate AI-Perf with the Dynamo Inference Stack, other NVIDIA inference stacks, and open-source inference frameworks, delivering end-to-end performance insights for researchers and production users

Qualification

PythonDistributed systemsAI infrastructurePerformance benchmarkingDeep learning frameworksOpen-source contributionsLarge-scale inference

Required

Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or related field—or equivalent experience
8+ years of experience in systems software, distributed performance engineering, or AI infrastructure research
Expert-level Python skills, including profiling, optimization, automation, and debugging of complex systems
Deep knowledge of distributed systems concepts, including scalability, concurrency, fault tolerance, and performance trade-offs

Preferred

Experience designing or maintaining performance benchmarking frameworks or tooling for AI/ML systems
Hands-on experience with LLMs and deep learning frameworks such as PyTorch, TensorFlow, TensorRT, or ONNX Runtime
Contributions to open-source or research projects in AI performance, infrastructure, or distributed systems
Experience running large-scale inference experiments across cloud and on-prem environments (AWS, Azure, GCP, bare metal)

Benefits

Equity
Comprehensive benefits package

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase