87 applicants

Company

NVIDIA · 2 days ago

Senior Deep Learning Systems Software Engineer - AI Infrastructure

United States

Full-time

Remote

Senior Level, Lead/Staff

$180K/yr - $339K/yr

8+ years exp

Maximize your interview chances

Artificial Intelligence (AI)GPU

Growth Opportunities

H1B Sponsor Likely

Insider Connection @NVIDIA

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Understand, analyze, profile, and optimize deep learning workloads on state-of-the-art hardware and software platforms.

Build tools to automate workload analysis, workload optimization, and other critical workflows.

Collaborate with cross-functional teams to analyze and optimize cloud application performance on diverse GPU architectures.

Identify bottlenecks and inefficiencies in application code and propose optimizations to enhance GPU utilization.

Drive end-to-end platform optimization from a hardware level to the application and service levels

Design and implement performance benchmarks and testing methodologies to evaluate application performance.

Provide guidance and recommendations on optimizing cloud-native applications for speed, scalability, and resource efficiency.

Share knowledge and best practices with domain expert teams as they transition applications to distributed environments.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Deep LearningGPU ArchitecturePerformance OptimizationPythonC/C++PytorchApplication Profiling ToolsLarge Scale Distributed SystemsAlgorithmsCloud ComputingLinux File SystemsNetworking

Required

Masters in CS, EE or CSEE or equivalent experience

8+ years of experience in application performance engineering

Experience using large scale multi node GPU infrastructure on premise or in CSPs

Background in deep learning model architectures and experience with Pytorch and large scale distributed training

Experience with application profiling tools such as NVIDIA NSight, Intel VTune etc.

Deep understanding of computer architecture, and familiarity with the fundamentals of GPU architecture. Experience with NVIDIA's Infrastructure and software stacks.

Proven experience analyzing, modeling and tuning DL application performance.

Proficiency in Python and C/C++ for analyzing and optimizing application code

Preferred

Strong fundamentals in algorithms and GPU programming experience (CUDA or OpenCL)

Understanding of NVIDIA's server and software ecosystem

Hands-on experience in performance optimization and benchmarking on large-scale distributed systems

Hands-on experience with NVIDIA GPUs, HPC storage, networking, and cloud computing.

In-depth understanding storage systems, Linux file systems, RDMA networking

Benefits

Equity

Benefits

Company

NVIDIA

Glassdoor

4.6

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

Founded in 1993

Santa Clara, California, USA

10,001+ employees

https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (735)

2022 (892)

2021 (696)

2020 (534)