Senior Software Architect - Deep Learning and HPC Communications jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 10 minutes ago

Senior Software Architect - Deep Learning and HPC Communications

NVIDIA is leading groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. They are seeking a Senior Software Architect to help co-design next-gen data center platforms and scalable communications software for Deep Learning and HPC applications.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Bella Yanovsky
linkedin

Responsibilities

Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems
Design and implement new communication technologies to accelerate AI and HPC workloads
Explore innovative solutions in HW and SW for our next generation platforms as part of co-design efforts involving GPU, Networking, and SW architects
Build proofs-of-concept, conduct experiments, and perform quantitive modeling to evaluate and drive new innovations
Use simulation to explore performance of large GPU clusters (think scales of 100s of 1000s of GPUs)

Qualification

C/C++ programmingParallel programming modelsCommunication runtimesDeep Learning FrameworksOperating systems knowledgeNetwork architectureLinux experienceInterpersonal skillsCollaborative skills

Required

M.S./Ph.D. degree in CS/CE or equivalent experience
5+ years of relevant experience
Excellent C/C++ programming and debugging skills
Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC)
Deep understanding of operating systems, computer and system architecture
Solid in fundamentals of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads
Strong experience with Linux
Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment

Preferred

Expertise in related technology and passion for what you do
Experience with CUDA programming and NVIDIA GPUs
Knowledge of high-performance networks like InfiniBand, RoCE, NVLink, etc
Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc
Knowledge of deep learning parallelisms and mapping to the communication subsystem
Experience with HPC applications
Strong collaborative and interpersonal skills and a proven track record of effectively guiding and influencing within a dynamic and multi-functional environment

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase