NVIDIA · 5 months ago
Senior AI Infrastructure Engineer - DGX Cloud
United States
Full-time
Remote
Senior Level
6+ years expNVIDIA is looking for a passionate and talented Senior AI Infrastructure Engineer to join their DGX Cloud group. This role involves designing, building, and maintaining large-scale production systems while ensuring maximum reliability and uptime for GPU cloud services. The engineer will engage in the full lifecycle of services, from inception to operation, while promoting a culture of collaboration and innovation.
Computer Hardware Manufacturing
Responsibilities
Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters
Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement
Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews
Maintain services once they are live by measuring and monitoring availability, latency and overall system health
Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
Practice sustainable incident response and blameless postmortems
Be part of an on call rotation to support production systems
Qualification
Required
BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience
6+ years of experience
A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others
Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production
Experience in one or more of the following: Python, Go, C/C++, Java
In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
Distributed system experience
Preferred
Interest in crafting, analyzing and fixing large-scale distributed systems
Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive
Ability to debug and optimize code and automate routine tasks
Experience in using or running large private and public cloud systems based on Kubernetes or Slurm
Benefits
Equity
Company
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing.
10,001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Late StageCompany data provided by crunchbase