NVIDIA · 1 day ago
Senior AI Software Engineer, GenAI Framework
United States
Full-time
Remote
Senior Level
$148K/yr - $288K/yr
5+ years expNVIDIA is seeking AI Software Engineers for their GenAI Frameworks team, which focuses on scalable and cloud-native frameworks for Large Language Models and Multimodal foundation model pretraining. The role involves designing and implementing distributed training algorithms, optimizing model performance, and collaborating with internal and open-source community partners.
Artificial Intelligence (AI)Consumer ElectronicsGPUHardwareSoftwareVirtual Reality
Hiring Manager
Deepika Yammanur (she/her/hers)
Responsibilities
Design and develop the GenAI open source Megatron Core and NeMo Framework
Solve large-scale, end-to-end AI training and inference challenges, spanning the full model lifecycle from initial orchestration, data pre-processing, and running of model training and tuning, to model deployment
Work at the intersection of AI applications, libraries, frameworks, and the entire software stack
Innovate and improve model architectures, distributed training algorithms, and model parallel paradigms
Accelerate foundation model training and finetuning with mixed precision recipes and next-gen NVIDIA GPU architectures
Performance tuning and optimizations of deep learning framework and software components
Research, prototype, and develop robust and scalable AI tools and pipelines
Qualification
Required
MS, PhD or equivalent experience in Computer Science, AI, Applied Math, or related fields and 5+ years of industry experience
Experience with AI Frameworks (e.g. PyTorch, JAX), and/or inference and deployment environments (e.g. TRTLLM, vLLM, SGLang)
Proficient in Python programming, software design, debugging, performance analysis, test design and documentation
Consistent record of working effectively across multiple engineering initiatives and improving AI libraries with new innovations
Strong understanding of AI/Deep-Learning fundamentals and their practical applications
Preferred
Hands-on experience in large-scale AI training, with a deep understanding of core compute system concepts (such as latency/throughput bottlenecks, pipelining, and multiprocessing) and demonstrated excellence in related performance analysis and tuning
Expertise in distributed computing, model parallelism, and mixed precision training
Prior experience with Generative AI techniques applied to LLM and Multi-Modal learning (Text, Image, and Video)
Knowledge of GPU/CPU architecture and related numerical software
Contributions to open source deep learning frameworks
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
2026-01-08
Company data provided by crunchbase