NVIDIA · 1 day ago
Senior Inference Technical Product Marketing Manager - Accelerated Computing
NVIDIA is a leading technology company at the forefront of Generative AI technologies, seeking a Senior Technical Product Marketing Manager for their data center business. The role focuses on driving NVIDIA's inference marketing strategy by collaborating with engineering teams to understand and articulate the technical capabilities of their inference stack.
Responsibilities
Help drive NVIDIA’s inference platform technical go-to-market efforts
Work closely with engineering and product management teams to understand key technical capabilities of our inference stack from GPUs, CPUs, networking, CUDA libraries, model architectures and deployment techniques (e.g.parallelisms, configurations, etc.)
Diligently review and remain up to date on model architectures, frameworks, arxiv papers, whitepapers deployment techniques (e.g.disaggregated serving, KV cache implementations) and identify intersection points between the latest AI models and NVIDIA’s platform to maximize performance and minimize TCO
Develop crisp clear positioning, messaging and assets to highlight NVIDIA’s leadership position in inference. Assets (blogs, whitepapers, presentations, analyst briefings, seminars at developer conferences)
Closely follow competitive inference announcements and prepare appropriate responses for business and technical/developer audiences
Assist on building keynote slides for executives for areas that you’re a subject matter expert
Qualification
Required
A BS Degree in Computer Science or Engineering or related field or equivalent experience in a technical product marketing role; Masters Degree preferred
6+ years of experience in LLM, AI/ML development in an engineering role followed by 5+ years of experience in product management or technical product marketing of AI/ML products
Deep understanding of modern data center architectures, accelerated computing, distributed inference, deep learning frameworks (PyTorch, TensorFlow, JAX), and inference-specific frameworks & optimizations (Dynamo, Triton Inference Server, TensorRT-LLM, vLLM, SGLang)
Market Awareness – Experience conducting technical competitive analysis and synthesizing key insights
Collaboration & Influence – Proven ability to work cross-functionally across engineering, product management, sales, and marketing teams
Strong Communication, Asset Creation & Storytelling – Ability to translate sophisticated technical concepts into clear, compelling narratives for both technical and business audiences
Ability to present to executive audiences
Preferred
Hands-on experience with AI inferencing workflows using NVIDIA or open-source serving frameworks running on accelerated computing in the data center
Experience developing LLM models
Experience working with hyperscale cloud providers
Hands-on Technical Competence – Background in software development, AI infrastructure, data center silicon
Demonstrated ability to engage with executive leadership and external partners
Published technical content or speaking experience at industry events
Have a portfolio of published marketing/launch assets
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Recent News
2026-01-04
The Motley Fool
2026-01-04
2026-01-04
Company data provided by crunchbase