NVIDIA · 2 days ago
Senior Software Engineer, Distributed Systems - NIM Factory
United States
Full-time
Remote
Senior Level, Lead/Staff
$168K/yr - $264K/yr
8+ years expNVIDIA is a leading technology company known for its advancements in AI-powered applications. They are seeking a Senior Software Engineer to design and build factory infrastructure and automation for NVIDIA Inference Microservices, focusing on optimizing and serving performant inferencing across various environments.
Artificial Intelligence (AI)Consumer ElectronicsGPUHardwareSoftwareVirtual Reality
Responsibilities
Develop a factory pipeline that will take an AI model in and produce a deployable service that is validated across Cloud, On-prem and Kubernetes environments
With the team, define and deliver rapid iterations on the group's technical strategies and roadmaps to deliver and improve the NIM factory
You will be designing interfaces, data modeling and schema design, and expanding observability over the factory pipeline and its compute infrastructure
Work with technical leaders designing and developing scalable and reliable factory components
You will collaborate with multiple AI model teams to understand their requirements to build an efficient infrastructure that improves every teams' productivity
Define metrics and drive improvements based on user feedback
You will mentor and collaborate throughout the team and with other teams to grow your colleagues and yourself
Qualification
Required
A history of using your advanced programming skills to build distributed and compute systems, backend services, microservices and cloud technologies
Effective experience working with multi-functional teams, principals and architects, across organizational boundaries
Mentorship, growing teams and team members, and the flexibility to ability to adjust your direction and expectations given the needs of our customers
Deep technical expertise in distributed containerize applications using technologies such as Docker, K8s, Cloud Endpoints, Helm, and Prometheus
Passion for building rich, microservice applications build and test automation pipeline
Excellent interpersonal skills and the ability to lead multi-functional efforts
Proven experience debugging and analyzing the performance of distributed microservices or cloud systems
BS or MS in Computer Science, Computer Engineering or related field (or equivalent experience)
8+ years of shown experience developing performant microservice, cloud software and/or tooling roles
Preferred
Experience delivering event-driven applications using various services such as Temporal, Kafka, Redis or others and a demonstrable ability to discuss the pros and cons of these choices
A history of building and deploying containers for Microservices, Cloud and On-prem deployments, and their associated CI/CD pipelines
Prior experience in working with large scale full stack development
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-01-08
Company data provided by crunchbase