Senior Deep Learning Systems Engineer, Datacenters jobs in United States
info-icon
This job has closed.
company-logo

NVIDIA · 1 day ago

Senior Deep Learning Systems Engineer, Datacenters

NVIDIA is a leading technology company known for its innovative approach in the Datacenter business. The Senior Deep Learning Systems Engineer will analyze performance and power consumption of deep learning applications on datacenter-class hardware and play a key role in optimizing datacenter designs.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Help develop software infrastructure to characterize and analyze a broad range Deep Learning applications
Evolve cost-efficient datacenter architectures tailored to meet the needs of Large Language Models (LLMs)
Work with experts to help develop analysis and profiling tools in Python, bash and C++ to measure key performance metrics of DL workloads running on Nvidia systems
Analyze system and software characteristics of DL applications
Develop analysis tools and methodologies to measure key performance metrics and to estimate potential for efficiency improvement

Qualification

Deep LearningSystem SoftwarePerformance AnalysisC/C++ ProgrammingPythonLinuxCUDADL FrameworksContainerization PlatformsDatacenter Workload ManagersVirtual Environments

Required

A Bachelor's degree in Electrical Engineering or Computer Science or equivalent experience (Masters or PhD degree preferred)
8 years or more of relevant experience
Experience in at least one of the following: System Software: Operating Systems (Linux), Compilers, GPU kernels (CUDA), DL Frameworks (PyTorch, TensorFlow)
Experience in Silicon Architecture and Performance Modeling/Analysis: CPU, GPU, Memory or Network Architecture
Experience programming in C/C++ and Python
A deep understanding of computer system architecture and performance analysis is essential for success in this role
Demonstrated ability to work in virtual environments, and a strong drive to own tasks from beginning to end

Preferred

Background with system software, Operating system intrinsics, GPU kernels (CUDA), or DL Frameworks (PyTorch, TensorFlow)
Experience with silicon performance monitoring or profiling tools (e.g. perf, gprof, nvidia-smi, dcgm)
In depth performance modeling experience in any one of CPU, GPU, Memory or Network Architecture
Exposure to Containerization Platforms (docker) and Datacenter Workload Managers (slurm)
Prior experience with multi-site teams or multi-functional teams

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase