NVIDIA · 21 hours ago
Senior AI Infrastructure Engineer, AI Tooling - DGX Cloud
United States
Full-time
Remote
Senior Level, Lead/Staff
$184K/yr - $356K/yr
8+ years expNVIDIA is a leading technology company seeking a Senior AI Infrastructure Engineer to design and build backend systems for their internal AI tools. This role focuses on developing robust infrastructure and scalable systems that support various applied AI initiatives, enhancing operational excellence through AI-powered tools and automation.
AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
Responsibilities
Build AI-powered tools that enhance operational excellence by leveraging diverse operational data, supporting incident, change, and problem management workflows
Collaborate closely with Incident Commanders, incident response, and SRE teams to integrate AI-driven automation and analytics into operational workflows
Design, develop, and maintain backend systems and infrastructure using Go and Python to support internal AI tools and intelligent agents
Build and maintain data pipelines using PySpark and related tools to support AI and analytics workflows
Operate and scale infrastructure using Kubernetes, managing containerized AI services and automating pipeline deployments
Work with vector databases to enable semantic search and retrieval-augmented generation use cases
Integrate large language models, agent systems, and classical ML models into internal services and automation workflows
Improve observability, deployment automation, and system reliability for AI-driven services
Qualification
Required
8+ years of software engineering experience, with deep expertise in backend systems and infrastructure
Bachelor's degree or equivalent experience
Strong proficiency in Python and Go, with a track record of delivering reliable, scalable software solutions
Experience designing scalable, maintainable backend systems and writing clear design documentation
Deep experience with Kubernetes and cloud-native infrastructure
Experience working with building, deploying, and maintaining ML models in production systems
Familiarity with AI agent frameworks or orchestration tools
Solid understanding of system observability, monitoring, and performance optimization
Strong collaboration and communication skills to work across remote teams
Preferred
Proven experience delivering AI-driven features end-to-end, from infrastructure design to production deployment
Experience with Temporal, Argo, or other workflow engines for multi-step or async job orchestration
Familiarity with vector databases and their applications in AI and LLM-powered systems
Contributions to open-source projects related to AI infrastructure, backend development, or developer tooling
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-01-08
Company data provided by crunchbase