Senior Research Engineer, Foundation Model Training Infrastructure jobs in United States
info-icon
This job has closed.
company-logo

NVIDIA · 1 week ago

Senior Research Engineer, Foundation Model Training Infrastructure

NVIDIA is searching for a senior or principal engineer who specializes in building cutting-edge infrastructure for large-scale foundation model training in the Generalist Embodied Agent Research (GEAR) group. The role involves designing and maintaining large-scale distributed training systems, optimizing GPU utilization, and collaborating with researchers to integrate model architectures into training pipelines.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Joshua Hasten
linkedin

Responsibilities

Design and maintain large-scale distributed training systems to support multi-modal foundation models for robotics
Optimize GPU and cluster utilization for efficient model training and fine-tuning on massive datasets
Implement scalable data loaders and preprocessors tailored for multimodal datasets, including videos, text, and sensor data
Develop robust monitoring and debugging tools to ensure the reliability and performance of training workflows on large GPU clusters
Collaborate with researchers to integrate cutting-edge model architectures into scalable training pipelines

Qualification

Distributed training systemsGPU accelerationMLOpsAI infrastructurePython programmingC++ programmingLarge-scale GPU clustersKubernetesJob scheduling toolsTech Lead experienceOpen-source contributions

Required

Bachelor's degree in Computer Science, Robotics, Engineering, or a related field
10+ years of full-time industry experience in large-scale MLOps and AI infrastructure
Proven experience designing and optimizing distributed training systems with frameworks like PyTorch, JAX, or TensorFlow
Deep understanding of GPU acceleration, CUDA programming, and cluster management tools like Kubernetes
Strong programming skills in Python and a high-performance language such as C++ for efficient system development
Strong experience with large-scale GPU clusters, HPC environments, and job scheduling/orchestration tools (e.g., SLURM, Kubernetes)

Preferred

Master's or PhD's degree in Computer Science, Robotics, Engineering, or a related field
Demonstrated Tech Lead experience, coordinating a team of engineers and driving projects from conception to deployment
Strong experience at building large-scale LLM and multimodal LLM training infrastructure
Contributions to popular open-source AI frameworks or research publications in top-tier AI conferences, such as NeurIPS, ICRA, ICLR, CoRL

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase