Modular · 13 hours ago
Kernel Engineer
Los Altos, CA
Full-time
Hybrid
Mid, Senior Level
$135K/yr - $204K/yrModular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. They are seeking an AI Kernel Engineer to design and optimize high-performance kernels for GPUs, enhancing the deployment of AI models and improving performance across various model families and frameworks.
AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
Responsibilities
Design and optimize high-performance ML numeric and data manipulation kernels
Benchmark kernel performance and conduct performance analysis
Diagnose performance bottlenecks and implement kernel improvements
Collaborate with framework and compiler teams to deliver end-to-end AI performance that fully utilizes new hardware or GPU capabilities
Ensure kernel correctness, maintainability, and test coverage
Qualification
Required
Experience in GPU programming and parallel computing
Solid understanding of CPU/GPU memory hierarchy and performance modeling
Proficiency in Python or C++
Familiarity with assembly language
Hands-on experience with GPU profiling and debugging tools
Strong foundation in algorithms and data structures
Deep interest in machine learning technologies and use cases
Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
Preferred
Experience with ML framework kernel development (Triton, PyTorch, TensorFlow XLA) and libraries (cuBLAS, CUTE etc.)
Knowledge of GPU ISA-level optimization (PTX, SASS, GCN)
Experience with multi-GPU communication frameworks (NCCL, RCCL, MPI)
Contributions to open-source GPU or HPC communities
Knowledge of AI algorithms and state-of-the-art LLMs
Benefits
Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Annual target bonus
Equity
Benefits
Company
Modular
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
Founded in 2022
51-200 employees
H1B Sponsorship
Modular has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)
Funding
Current Stage
Growth StageTotal Funding
$380MKey Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M
Leadership Team
Chris Lattner
CEO + Co-Founder
Tim Davis
Co-Founder & President
Recent News
General Catalyst
2026-01-14
General Catalyst
2026-01-14
Greylock
2025-12-29
Company data provided by crunchbase