Senior Systems Engineer – High-Performance AI and Networking Applications jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 2 weeks ago

Senior Systems Engineer – High-Performance AI and Networking Applications

NVIDIA is a leader in AI and networking solutions, seeking a Senior Systems Engineer for their Deep Learning Frameworks Infrastructure team. This role focuses on enhancing performance in high-performance AI and networking applications through collaboration and technical mentorship.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Collaborate with networking teams to plan, implement, and evaluate performance benchmarks on NVLINK, NVSwitch, and InfiniBand powered infrastructures
Assess findings and work closely with framework, hardware, and support teams to improve system performance across various deep learning workloads
Act as a primary resource for fixing networking and hardware integration issues, focusing on scalable multi-node systems
Maintain high communication standards across multiple engineering, support, and R&D teams, ensuring technical and performance goals are met
Offer technical mentorship and documentation for internal teams and external partners on standard methodologies in HPC networking deployments
Share insights on improving networking strategies for substantial AI and deep learning infrastructure

Qualification

AI/HPC InfrastructureHigh-Speed NetworkingDeep Learning FrameworksAI/HPC job schedulersMulti-node systemsAnalytical skillsTechnical communicationCollaborative teamwork

Required

BS/MS or PhD in Computer Science, Engineering, or related field, or equivalent experience
8+ years of proven experience in AI/HPC Infrastructure
Familiarity with AI/HPC job schedulers and orchestrators like Slurm, K8s, or LSF. Practical exposure to AI/HPC workflows employing MPI and NCCL
Familiarity with High-Speed Networking pertaining to HPC including InfiniBand, RDMA, RoCE, and Amazon EFA
Essential to have an understanding of PyTorch, MegatronLM, and Deep Learning Inference frameworks such as vllm/sglang
Proven experience with InfiniBand, NVLINK, and high-speed networking technologies in HPC or large-scale datacenter environments
Investigating and evaluating performance in multi-node systems, especially in deep learning or scientific computing tasks
Strong analytical, debugging, and technical communication skills
Comfortable working in collaborative, multi-faceted teams

Preferred

Mastery in deep learning frameworks or distributed training systems
Familiarity with datacenter automation, advanced network protocols, and supporting large HPC or AI clusters in production environments
Understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workload
Experience with networking and communications libraries like NCCL, NIXL, NVSHMEM, UCX
Experience developing or maintaining cluster management and monitoring tools Ex: ansible for infrastructure as a service, prometheus and grafana for monitoring

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase