Senior Deep Learning Software Engineer, PyTorch - TensorRT Performance jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 7 hours ago

Senior Deep Learning Software Engineer, PyTorch - TensorRT Performance

NVIDIA is seeking an experienced Deep Learning Software Engineer to enhance the performance of Torch inference with TensorRT. The role involves collaborating with various teams to optimize deep learning models and contribute to NVIDIA's OSS inference frameworks.

Artificial Intelligence (AI)Consumer ElectronicsGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Khai N.
linkedin

Responsibilities

Analyze performance issues and identify performance optimization opportunities inside Torch-TensorRT/TensorRT
Contribute features and code to NVIDIA/OSS inference frameworks including but not limited to Torch-TensorRT/TensorRT/PyTorch
Work with cross-collaborative teams inside and outside of NVIDIA across generative AI, automotive, robotics, image understanding, and speech understanding to develop innovative inference solutions
Scale performance of deep learning models across different architectures and types of NVIDIA accelerators

Qualification

Deep LearningPyTorchPerformance OptimizationPythonC++GPU ProgrammingSoftware DesignSoftware EngineeringPerformance AnalysisCollaboration

Required

Bachelors, Masters, PhD, or equivalent experience in relevant fields (Computer Science, Computer Engineering, EECS, AI)
At least 4 years of relevant software development experience
Excellent Python/C++ programming, software design and software engineering skills
Experience with a DL framework like PyTorch, JAX, TensorFlow
Experience with performance analysis and performance optimization

Preferred

Architectural knowledge of GPU
Prior experience with a AoT or JiT compiler in deep learning inference, e.g. TorchDynamo/TorchInductor
Prior experience with performance modeling, profiling, debug, and code optimization of a DL/HPC/high-performance application
GPU programming experience and proficiency in one of the GPU programming domain specific languages, e.g. CUDA/TileIR/CuTeDSL/cutlass/Triton

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase