Senior Software Architect, AI Networking jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 1 day ago

Senior Software Architect, AI Networking

positionAustin, TX
timeFull-time
remoteOnsite
senioritySenior Level, Lead/Staff
money$184K/yr - $288K/yr
date8+ years exp

NVIDIA has been transforming computer graphics and accelerated computing for over 25 years. They are seeking a Senior Software Architect for AI Networking to drive performance and scalability in distributed AI systems, focusing on optimizing data processing for large language models and generative AI workloads.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Research, design, and implement advanced AI networking technologies with an emphasis on accelerating inference workloads using NVIDIA Inference Xfer Library (NIXL)—a high-throughput, low-latency communication library for asynchronous, efficient data transfers across GPUs, CPUs, and various storage targets
Collaborate with other teams across NVIDIA's hardware, software, and research units to co-design hardware-accelerated and software solutions for AI inference
Own the creation of prototypes and solutions for next-generation AI inference systems
Drive architectural decisions underpinning the deployment and scaling of AI inference using NVIDIA’s innovative technology

Qualification

AI networking technologiesMachine Learning/Deep LearningCC++ programmingNVIDIA Inference Xfer LibraryDeep Learning frameworksPrototyping skillsArchitectural decision-makingCollaboration skills

Required

Master's or Ph.D. in Computer Science, Electrical or Computer Engineering or equivalent experience
At least 8 years of relevant academic or confirmed experience in the field
Comprehensive understanding of AI workloads (primarily inference, but also training) and their impact on network infrastructure
Strong proficiency in areas such as Machine Learning/Deep Learning fundamentals, inference runtimes, and Deep Learning frameworks
Proficiency in C or C++ for systems software development

Preferred

Familiarity with Rust is an advantage

Benefits

Equity
Benefits

Company

NVIDIA

twittertwittertwitter
Glassdoor4.6
company-logo
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
dateFounded in 1993
location
Santa Clara, California, USA
people-size10001+ employees
web-link
https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin

Recent News

IndiaTimes
After 'surprise car announcement', Nvidia CEO Jensen Huang meets CEOs of Mercedes and Hyundai
2026-01-08
IndiaTimes
CEO Jensen Huang confirms, Nvidia’s $500 billion AI demand outlook won't …
2026-01-08
IndiaTimes
Elon Musk's ChatGPT rival xAI raises $20 billion in funding; investors include Nvidia which has promised up to $100 billion to Sam Altman's OpenAI
2026-01-08
Company data provided by crunchbase