Backend Engineer, Multi-cloud Kubernetes platform jobs in United States
cer-icon
Apply on Employer Site
company-logo

Modular · 1 month ago

Backend Engineer, Multi-cloud Kubernetes platform

positionUnited States / Canada
timeFull-time
remoteOnsite
senioritySenior Level
money$167K/yr - $273K/yr
date5+ years exp

Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. The role involves building a multi-cloud platform for AI inference services, focusing on operational excellence and scalability.

AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
check
H1B Sponsor Likelynote

Responsibilities

Build the multi-cloud, multi-tenant platform powering Modular’s inference services
Build fault-tolerant, low toil services able to make use of resources in a variety of hardware platforms Clouds (Tier 1 Cloud Providers & neoclouds)
Push the envelope for operational excellence with request-to-kernel observability, multi-cloud deployments, cold-start optimizations, and more
Build helm charts, kubernetes operators, and more to make a create simple, effective, aintainable deployments

Qualification

Backend engineeringKubernetesCloud ProvidersMachine learningCuriositySecurity in multi-tenancyHigh scale ML inferenceGolangProblem solvingTeam-orientedCreativity

Required

5+ years of experience working in backend engineering
Experience with Cloud Providers (AWS, GCP, Azure, neoclouds)
Experience with kubernetes and operating your own services
A passion for building and operating high performance, low toil, observable systems
Experience in machine learning technologies and use cases
Creativity and curiosity for solving complex problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
Strongly identifies with our core company cultural values

Preferred

Practical experience implementing & maintaining security in multi-tenancy environments
Experience working on high scale ML inference infrastructure (traditional AI or genAI)
Familiarity with golang

Benefits

Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Annual target bonus
Equity
Team Building Events

Company

Modular

twittertwittertwitter
company-logo
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
dateFounded in 2022
location
Palo Alto, California, USA
people-size51-200 employees
web-link
https://www.modular.com

H1B Sponsorship

Modular has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)

Funding

Current Stage
Growth Stage
Total Funding
$380M
Key Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M

Leadership Team

leader-logo
Chris Lattner
CEO + Co-Founder
linkedin
leader-logo
Tim Davis
Co-Founder & President
linkedin

Recent News

Greylock
Greylock Portfolio - Modular
2025-12-29
W&B
Modular Raises $30 Million To Create Platform-Agnostic AI Dev Platform
2025-12-01
Crunchbase News
Highest Count Of New Unicorns Join Crunchbase Board In Over 3 Years As Exits Also Gain Steam
2025-10-15
Company data provided by crunchbase