Principal Architect, AI Networking jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 1 day ago

Principal Architect, AI Networking

NVIDIA has been redefining computer graphics and accelerated computing for over 25 years, focusing on the potential of AI to shape the future of computing. As a Software Architect for AI Networking, you will drive technological innovation and craft the future of AI networking using cutting-edge technologies to solve complex challenges.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Work on accelerating NVIDIA Dynamo - KV cache management and large-scale inference
Developing and researching groundbreaking networking technologies to advance and scale AI networks
Co-designing software and hardware networking solutions across various networking related domains, from network transports to AI frameworks
Working closely with NVIDIA's hardware architecture, software architecture, and research teams to build innovative networking hardware and software solutions
Leading the development of prototypes that optimize AI training and inference infrastructure

Qualification

AI workloads understandingMachine Learning fundamentalsCC++ programmingDeep Learning frameworksLLM inference experienceStorage optimization knowledgeCuriosity for technologyCommunication skills

Required

Master's or Ph.D. in Computer Science, Electrical or Computer Engineering from a top-tier university (or related field) (or equivalent experience)
12+ years of relevant academic or proven experience in the field
Comprehensive understanding of AI workloads (primarily inference, but also training) and their impact on network infrastructure
Strong proficiency in Machine Learning/Deep Learning fundamentals, inference runtimes, and Deep Learning frameworks
Skilled in C or C++ for systems software development; familiarity with Rust is helpful
Curiosity for building leading edge technology
Ability to work and communicate effectively across diverse teams with varying expertise and time zones

Preferred

Proven research track record
Experience in LLM inference, AI network and storage needs
Background in storage and storage optimization: file systems, object store, caches, coherency
Stellar communication skills

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase