NVIDIA ยท 5 months ago
Senior Software Engineer, GPU Communications and Networking
US, CA, Santa Clara
Full-time
Hybrid
Senior Level
$148K/yr - $288K/yr
5+ years expNVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. They are seeking a highly motivated senior software engineer to develop and maintain software for complex heterogeneous computing systems that power disruptive products in High Performance Computing and Deep Learning.
Computer Hardware Manufacturing
Responsibilities
Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/Pytorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters
Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM
Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components
Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware
Qualification
Required
M.S./Ph.D. degree in CS/CE or equivalent experience
5+ years of relevant experience
Excellent C/C++ programming and debugging skills
Strong experience with Linux
Expert understanding of computer system architecture and operating systems
Experience with parallel programming interfaces and communication runtimes
Ability and flexibility to work and communicate effectively in a multi-national, multi-time-zone corporate environment
Preferred
Deep understanding of technology and passionate about what you do
Experience with CUDA programming and NVIDIA GPUs
Knowledge of high-performance networks like InfiniBand, iWARP etc
Experience with HPC applications
Experience with Deep Learning Frameworks such PyTorch, TensorFlow, etc
Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic matrix environment
Benefits
Equity
Comprehensive benefits package
Company
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing.
10,001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Late StageCompany data provided by crunchbase