Modular · 1 week ago
AI Frameworks Engineer
Los Altos, CA
Full-time
Hybrid
Mid, Senior Level
$198K/yr - $242K/yr
4+ years expModular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack from the ground up. They are seeking an AI Frameworks Engineer to develop innovative AI frameworks and enhance developer experience while collaborating with teams and mentoring junior engineers.
AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
Responsibilities
Craft and implement new MAX framework and runtime features atop our MLIR-based compiler architecture
Develop interoperability solutions with various frameworks, and participate in the design of Modular’s internal stack
Develop user-facing ML development infrastructure, APIs and language extensions
Dream up and realize what the next generation NN framework should look like, how it will map to the heterogeneity of the world to make GPUs, CPUs, and accelerators sing in harmony
Participate in design discussions and code reviews to uphold high engineering standards
Collaborate and engage with the Modular core teams, researchers, and the external Modular and open source community to support high-quality contributions and foster a welcoming, inclusive environment
Mentor junior engineers and support their growth
Qualification
Required
4+ years sculpting AI frameworks or runtime implementations
Hands-on mastery of Python, data structures and algorithms
Experience developing machine learning frameworks and APIs like PyTorch, TensorFlow, ONNX, JAX, or similar
Familiarity with compiler infrastructure and the willingness to master them quickly
A deep curiosity for deep neural networks
Good understanding of ML-specific representations like computation graphs
A collaborative mindset, intellectual curiosity, and a drive to solve complex technical challenges as part of a high-performing team
Clear and effective communication skills, both written and verbal
Strong alignment with Modular's cultural values and a desire to help build a thoughtful, inclusive engineering culture
Preferred
Contributions to PyTorch, TensorFlow, Scikit-Learn or other real-world languages
Experience with HPC or accelerator ecosystems (CUDA, SYCL, OpenCL, etc.)
Familiarity with production-system-LLMs or other Transformer architectures
An advanced degree in Computer Science or a related field or equivalent experience
Benefits
Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Stock options
Company
Modular
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
51-200 employees
H1B Sponsorship
Modular has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)
Funding
Current Stage
Growth StageTotal Funding
$380MKey Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M
Leadership Team
Chris Lattner
CEO + Co-Founder
Tim Davis
Co-Founder & President
Recent News
General Catalyst
2026-01-14
General Catalyst
2026-01-14
Greylock
2025-12-29
Company data provided by crunchbase