NVIDIA · 4 hours ago
Product Manager, AI Platform Kernels and Communication Libraries
NVIDIA's AI Software Platforms team is seeking a technical product manager to accelerate next-generation inference deployments through innovative libraries and frameworks. The role focuses on bridging low-level GPU programming with developer enablement and involves collaborating with engineers and open-source communities to define product strategies.
Responsibilities
Architect developer-focused products that simplify high-performance inference and training deployment across diverse GPU architectures
Define the multi-year strategy for kernel and communication libraries by analyzing performance bottlenecks in emerging AI workloads
Collaborate with CUDA kernel engineers to design intuitive, high-level abstractions for memory and distributed execution
Partner with open-source communities like Triton and FlashInfer to shape and drive ecosystem-wide roadmaps
Qualification
Required
7+ years of technical PM experience shipping developer products for GPU acceleration, with expertise in HPC optimization stacks
Expert-level understanding of CUDA execution models and multi-GPU protocols, with a proven track record to translate hardware capabilities into software roadmaps
BS or MS or equivalent experience in Computer Engineering or demonstrated expertise in parallel computing architectures
Strong technical interpersonal skills with experience communicating complex optimizations to developers and researchers
Preferred
PhD or equivalent experience in Computer Engineering or a related technical field
Contributed to performance-critical open-source projects like Triton, FlashAttention, or TVM with measurable adoption impact
Crafted GitHub-first developer tools with >1k stars or similar community engagement metrics
Published research on GPU kernel optimization, collective communication algorithms, or ML model serving architectures
Experience building cost-per-inference models incorporating hardware utilization, energy efficiency, and cluster scaling factors
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Recent News
2026-01-25
Unified Communications fuel big enterprise success | CIO
2026-01-25
2026-01-25
Company data provided by crunchbase