Modular · 1 day ago
Mojo Libraries Engineer
United States
Full-time
Remote
Mid, Senior Level
$167K/yr - $286K/yrModular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack from the ground up. As a Mojo Libraries Engineer, you will design and implement core abstractions across the Mojo Standard Library and kernel libraries, enabling developers to efficiently integrate with AI systems and accelerate innovation across the AI stack.
AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
Responsibilities
Partner with teams across Modular—including compiler, kernel, and runtime engineers—to design APIs that are ergonomic, expressive, and performance-conscious. Your work will directly shape the developer experience and deliver high business impact by enabling critical customer workloads and accelerating platform adoption
Design and implement abstractions that enable the development and optimization of kernels and algorithms running on GPUs and CPUs, delivering top-tier performance and accuracy throughout the GenAI inference solution stack
Optimize library functionality for performance, memory efficiency, and hardware utilization
Participate in design discussions and code reviews to uphold high engineering standards
Collaborate with other engineering teams to align the standard library with broader platform needs
Contribute to a fully open source project — everything you build will be public and part of our GitHub repo
Engage with the open source community to support high-quality contributions and foster a welcoming, inclusive environment
Qualification
Required
Experience with GPU programming languages like CUDA or OpenCL
Deep understanding of GPU architecture (memory hierarchies, tensor cores, etc.) and how it influences algorithm and API design
Proficiency in modern systems languages (C++, Rust, or Swift), with strong skills in low-level programming, performance optimization, and memory management
Passion for both library design and performance, with a commitment to following modern API patterns and language evolution in C++, Rust, and Swift ecosystems
Hands-on open source experience — either through meaningful contributions or by maintaining and reviewing community submissions
A collaborative mindset, intellectual curiosity, and drive to solve complex technical challenges as part of a high-performing team
Strong alignment with Modular's cultural values and enthusiasm for building a thoughtful, inclusive engineering culture
Preferred
Familiarity with GPU assembly languages such as PTX and SASS
Knowledge of cutting-edge APIs such as CUTLASS or Triton
Prior experience with Mojo, especially with accepted contributions to the Mojo Standard Library
Familiarity with LLVM, MLIR, or Python, particularly in systems or compiler-related contexts
An advanced degree in Computer Science or a related field
Benefits
Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Stock options
Company
Modular
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
Founded in 2022
51-200 employees
H1B Sponsorship
Modular has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)
Funding
Current Stage
Growth StageTotal Funding
$380MKey Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M
Leadership Team
Chris Lattner
CEO + Co-Founder
Tim Davis
Co-Founder & President
Recent News
General Catalyst
2026-01-14
General Catalyst
2026-01-14
Greylock
2025-12-29
Company data provided by crunchbase