AI Kernel Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Modular · 1 month ago

AI Kernel Engineer

positionUnited States / Canada
timeFull-time
remoteOnsite
seniorityMid, Senior Level
money$167K/yr - $242K/yr

Modular is a company focused on revolutionizing AI infrastructure by rebuilding the AI software stack. As an AI Kernel Engineer, you will design and optimize high-performance kernels for GPUs, driving performance improvements and enabling developers to deploy AI models more efficiently.

AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
check
H1B Sponsor Likelynote

Responsibilities

Design and optimize high-performance ML numeric and data manipulation kernels
Benchmark kernel performance and conduct performance analysis
Diagnose performance bottlenecks and implement kernel improvements
Collaborate with framework and compiler teams to deliver end-to-end AI performance that fully utilizes new hardware or GPU capabilities
Ensure kernel correctness, maintainability, and test coverage

Qualification

GPU programmingParallel computingPythonC++Performance modelingAssembly languageGPU profiling toolsAlgorithmsData structuresMachine learning interestKernel correctnessTest coverageProblem-solving creativityTeam-oriented attitude

Required

Experience in GPU programming and parallel computing
Solid understanding of CPU/GPU memory hierarchy and performance modeling
Proficiency in Python or C++
Familiarity with assembly language
Hands-on experience with GPU profiling and debugging tools
Strong foundation in algorithms and data structures
Deep interest in machine learning technologies and use cases
Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture

Preferred

Experience with ML framework kernel development (Triton, PyTorch, TensorFlow XLA) and libraries (cuBLAS, CUTE etc.)
Knowledge of GPU ISA-level optimization (PTX, SASS, GCN)
Experience with multi-GPU communication frameworks (NCCL, RCCL, MPI)
Contributions to open-source GPU or HPC communities
Knowledge of AI algorithms and state-of-the-art LLMs

Benefits

Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Annual target bonus
Equity
Team Building Events

Company

Modular

twittertwittertwitter
company-logo
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
dateFounded in 2022
location
Palo Alto, California, USA
people-size51-200 employees
web-link
https://www.modular.com

H1B Sponsorship

Modular has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)

Funding

Current Stage
Growth Stage
Total Funding
$380M
Key Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M

Leadership Team

leader-logo
Chris Lattner
CEO + Co-Founder
linkedin
leader-logo
Tim Davis
Co-Founder & President
linkedin

Recent News

Greylock
Greylock Portfolio - Modular
2025-12-29
W&B
Modular Raises $30 Million To Create Platform-Agnostic AI Dev Platform
2025-12-01
Crunchbase News
Highest Count Of New Unicorns Join Crunchbase Board In Over 3 Years As Exits Also Gain Steam
2025-10-15
Company data provided by crunchbase