NVIDIA · 6 hours ago
Senior DGX Cloud AI Infrastructure Software Engineer
US, TX, Austin
Full-time
Onsite
Senior Level, Lead/Staff
$184K/yr - $288K/yr
8+ years expNVIDIA is a leader in groundbreaking developments in Artificial Intelligence, High-Performance Computing, and Visualization. They are seeking a Senior DGX Cloud AI Infrastructure Software Engineer to contribute to the infrastructure that powers innovative AI research, focusing on developing tools for optimizing efficiency and resiliency of AI workloads.
AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
Responsibilities
Develop infrastructure software and tools for large-scale pre-training, post-training, and inference
Develop and optimize tools and libraries to improve infrastructure efficiency and resiliency
Co-design and implement APIs for integration with NVIDIA's resiliency stacks
Enhance infrastructure and products underpinning NVIDIA's AI platforms
Define meaningful and actionable reliability metrics to track and improve system and service reliability
Skilled in problem-solving, root cause analysis, and optimization
Root cause and analyze and triage failures from the application level to the hardware level
Qualification
Required
Minimum of 8+ years of experience in developing software infrastructure for large scale AI systems
Bachelor's degree or higher in Computer Science or a related technical field (or equivalent experience)
Strong debugging skills and experience in analyzing and triaging AI applications from the application level to the hardware level
Experience with observability platforms for monitoring and logging (e.g., ELK, Prometheus, Loki)
Proven track record in building and scaling large-scale distributed systems
Experience with AI training and inferencing infrastructure services
Proficiency in programming languages such as Python, C/C++, script languages
Experience in quality software engineering practices, including test development, defensive programming, version control, and CI
Excellent communication and collaboration skills, and a culture of diversity, intellectual curiosity, problem solving, and openness are essential
Preferred
Background in working with the large scale clusters
Experience in defining and building observability and telemetry software stack
Experience with RDMA software stack (NCCL, IB verbs, ucx, libfabrics)
Experience and root cause analysis of failures and datacenter scale
Good understanding on DL frameworks internal PyTorch, TensorFlow, JAX, and Ray
Benefits
Equity
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-01-25
Unified Communications fuel big enterprise success | CIO
2026-01-25
2026-01-25
Company data provided by crunchbase