NVIDIA · 5 months ago
Senior AI-HPC Cluster Engineer - MLOps
United States
Full-time
Remote
Senior Level
6+ years expNVIDIA has been a leader in computer graphics and computing for over 25 years, now focusing on AI technology. The Senior AI-HPC Cluster Engineer will lead the management of large-scale HPC systems, develop automation solutions, and support researchers with performance analysis and optimizations.
Computer Hardware Manufacturing
Responsibilities
Provide leadership and strategic mentorship on the management of large-scale HPC systems including the deployment of compute, networking, and storage
Develop and improve our ecosystem around GPU-accelerated computing including developing scalable automation solutions
Build and nurture customer and cross-team relationships to consistently support the clusters and address changing user needs
Support our researchers to run their workloads including performance analysis and optimizations
Conduct root cause analysis and suggest corrective action. Proactively find and fix issues before they occur
Build innovative tooling to accelerate researchers' velocity, troubleshooting, and software performance at scale
Qualification
Required
Bachelor's degree in Computer Science, Electrical Engineering or related field or equivalent experience
Minimum of 6 years of experience crafting and operating large scale compute infrastructure
Experience with AI/HPC job schedulers and orchestrators, such as Slurm, K8s or LSF. Applied experience with AI/HPC workflows that use MPI and NCCL
Proficient in using Linux including Centos/RHEL and/or Ubuntu Linux distributions. A solid understanding of container technologies like Enroot, Docker and Podman
Proficiency in one scripting language (Python, Bash) and at least one compiled language (Golang, Rust, C, C++...)
Experience analyzing and tuning performance for a variety of AI/HPC workloads. Excellent problem-solving to analyze complex systems, identify bottlenecks, and implement scalable solutions
Excellent communication and teamwork skills, with the ability to work effectively with diverse teams and individuals
Passion for continual learning and staying ahead of new technologies and effective approaches in the HPC and AI/ML infrastructure fields
Preferred
Experience with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking
Experience with Machine Learning and Deep Learning concepts, algorithms and models
Familiarity with High-Speed Networking pertaining to HPC including InfiniBand, RDMA, RoCE and Amazon EFA
Understanding of fast, distributed storage systems like Lustre and GPFS for AI/HPC workload. Experience working with deep learning frameworks including PyTorch, MegatronLM and TensorFlow
Familiarity with metrics collection and visualization at scale with Prometheus, OpenSearch and Grafana
Benefits
Equity
Benefits
Company
NVIDIA
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing.
10,001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Late StageCompany data provided by crunchbase