Senior DL Algorithms Engineer - Inference Performance jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 5 months ago

Senior DL Algorithms Engineer - Inference Performance

NVIDIA is seeking senior engineers who are mindful of performance analysis and optimization to help us squeeze every last clock cycle out of Deep Learning workloads. This role offers an opportunity to directly impact the hardware and software roadmap in a fast-growing technology company that leads the AI revolution.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Implement language and multimodal model inference as part of NVIDIA Inference Microservices (NIMs)
Contribute new features, fix bugs and deliver production code to TRT-LLM, NVIDIA’s open-source inference serving library
Profile and analyze bottlenecks across the full inference stack to push the boundaries of inference performance
Benchmark state-of-the-art offerings in various DL models inference and perform competitive analysis for NVIDIA SW/HW stack
Collaborate heavily with other SW/HW co-design teams to enable the creation of the next generation of AI-powered services

Qualification

Deep LearningPerformance OptimizationC++GPU ArchitecturePyTorchNeural NetworksPerformance ProfilingAlgorithmsCUDAOpenCL

Required

PhD in CS, EE or CSEE or equivalent experience
5+ years of experience
Strong background in deep learning and neural networks, in particular inference
Experience with performance profiling, analysis and optimization, especially for GPU-based applications
Proficient in C++, PyTorch or equivalent frameworks
Deep understanding of computer architecture, and familiarity with the fundamentals of GPU architecture

Preferred

Proven experience with processor and system-level performance optimization
Deep understanding of modern LLM architectures
Strong fundamentals in algorithms
GPU programming experience (CUDA or OpenCL) is a plus

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase