Senior Math Libraries Engineer, CPU and GPU Optimization jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 3 weeks ago

Senior Math Libraries Engineer, CPU and GPU Optimization

NVIDIA is looking for an expert software engineer to help deliver CUDA-X libraries across their CPU and GPU ecosystem. The role involves designing, developing, and optimizing math libraries to support high-performance computing and AI applications.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design modern, flexible, and easy to use APIs and kernels for math libraries and lead design reviews with all collaborators
Work closely with internal (e.g., Engineering, Product Management) and external partners such as researchers to understand their use cases and requirements
Work with internal and external customers to deliver timely math libraries releases
Become a domain expert by continuously surveying current trends in software systems

Qualification

High-performance computingAdvanced C++CUDA programmingPythonNumerical methodsCross-compilationCollaboration skillsCommunication skillsDocumentation skills

Required

PhD or MSc degree in Computer Science, Applied Math, or a related science or engineering field is preferred (or equivalent experience)
12+ years of experience designing and developing software for high-performance computing and/or AI applications
Advanced C++ skills, including modern design paradigms (e.g., template meta-programming, RAII)
Parallel programming experience with CUDA, OpenCL or vector programming on CPU (AVX, NEON or similar)
Strong collaboration, communication, and documentation habits
Experience with ARM, RISC-V and/or x86_64 CPU architectures

Preferred

Strong background in numerical methods (e.g., FFT, numerical linear algebra)
Programming skills with Python, and modern automation setups for both building software (e.g. cmake) as well as testing it (e.g. CI/CD, sanitizers)
Experience with cross-compilation, setting up CPU/GPU/accelerator (cross-)compilation toolchains and bringing existing codes to new architectures
Background with CCCL, OpenMP, OpenACC, multi-threading, MPI, PGAS
Experience with scientific and deep learning libraries and frameworks such as PyTorch, JAX, MKL, MAGMA, PETSc, Kokkos, etc

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase