Senior MLOps Engineer, GenAI Framework jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 15 hours ago

Senior MLOps Engineer, GenAI Framework

NVIDIA is looking for a dedicated and motivated senior build and continuous integration (CI/CD) engineer for its GenAI Frameworks team. The role involves architecting and managing continuous integration pipelines and release processes, designing scalable DevOps solutions, and collaborating with deep learning teams to optimize performance and user experience.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Deepika Yammanur (she/her/hers)
linkedin

Responsibilities

Architect and manage the continuous integration pipelines and release processes of our Generative AI framework and libraries related to Megatron-LM and NeMo Framework
Design and implement efficient and scalable DevOps solutions to allow our fast growing team to release software more frequently while maintaining high-quality and maximum performance
Work with industry standard tools (Kubernetes, Docker, Slurm, Ansible, GitLab, GitHub Actions, Jenkins, Artifactory, Jira) in hybrid on-premise and cloud environments
Assist with cluster operations and system administration (managing: servers, team accounts, clusters)
Accelerate research and development cycles by automating recurring tasks such as accuracy and performance regression detection
Developing new quality control measures, e.g. code analysis, backwards compatibility, and regression testing, while employing and advancing best-practices
Work closely with DL frameworks and libraries (CUDA, cuDNN, cuBLAS, and PyTorch) teams and with other engineering teams within NVIDIA that provide software, testing, and release related infrastructure

Qualification

CI/CDDevOps solutionsLinux administrationContainerizationPythonKubernetesDockerGitLabGitHubProblem-solvingTeam collaborationCommunication skills

Required

BS or MS degree in Computer Science, Computer Architecture or related technical field (or equivalent experience) and 6+ years of industry experience in DevOps and infrastructure engineering
Strong system level programming in languages like Python and shell scripting
Extensive understanding of build/release systems, CI/CD and experience with solutions like Gitlab, Github, Jenkins etc
Experience with Linux system administration
Proficient with containerization and cluster management technologies like Docker and Kubernetes
Experience in build tools, including Make, Cmake
A strong background in source code management (SCM) solutions such as GitLab, GitHub, Perforce, etc
Well-versed problem-solving and debugging skills
Great teammate who can collaborate and influence others in a dynamic environment
Excellent interpersonal and written communication skills

Preferred

Proven-track record with GPU accelerated systems at scale
Well-versed in DL frameworks such as PyTorch, Jax, or TensorFlow
Expertise in cluster and cloud compute technologies, e.g.: SLURM, Lustre, k8s
Software and hardware Benchmarking on high-performance computing systems

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase