Platform Engineer, AI Inference jobs in United States
cer-icon
Apply on Employer Site
company-logo

Modular · 19 hours ago

Platform Engineer, AI Inference

positionLos Altos, CA
timeFull-time
remoteHybrid
senioritySenior Level
money$198K/yr - $286K/yr
date5+ years exp

Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. They are seeking a Platform Engineer to own and improve systems that support Cloud Inference products, balancing hands-on development with technical leadership.

AI InfrastructureArtificial Intelligence (AI)Generative AIMachine LearningSoftware
check
H1B Sponsor Likelynote

Responsibilities

Shape the technical platform for large scale AI inference
Promote technical and team excellence through collaboration and leadership
Develop and maintain core platform capabilities — traditional and high performance networking, k8s clusters, etc

Qualification

KubernetesCloud servicesAI inferenceSecurity best practicesMulti-cloud experienceHigh performance networkingCollaboration skillsProblem-solvingTechnical leadership

Required

5+ years of relevant experience
Experience maintaining Kubernetes clusters and applications
Experience building, deploying, and supporting cloud services (bonus points for multi-cloud)
Comfort working across clouds, tools, and systems—focusing on problem-solving rather than specific technologies
Able to articulate and implement security best-practices
Strong collaboration skills and ability to share information with internal engineering and product teams
Alignment with our core company cultural values

Preferred

Experience with GPUs, high performance networking (RDMA, infiniband, etc)
Geographically distributed multi-region hub-and-spoke cluster topologies

Benefits

Premier insurance plans
Up to 5% 401k matching
Flexible paid time off
Stock options
Annual target bonus
Equity

Company

Modular

twittertwittertwitter
company-logo
Modular provides AI infrastructure for deployment, serving, and programming GPUs.
dateFounded in 2022
location
Palo Alto, California, USA
people-size51-200 employees
web-link
https://www.modular.com

H1B Sponsorship

Modular has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (6)
2023 (8)
2022 (4)

Funding

Current Stage
Growth Stage
Total Funding
$380M
Key Investors
US Innovative Technology FundGeneral CatalystGoogle Ventures
2025-09-24Series C· $250M
2023-08-24Series B· $100M
2022-06-30Seed· $30M

Leadership Team

leader-logo
Chris Lattner
CEO + Co-Founder
linkedin
leader-logo
Tim Davis
Co-Founder & President
linkedin

Recent News

Greylock
Greylock Portfolio - Modular
2025-12-29
W&B
Modular Raises $30 Million To Create Platform-Agnostic AI Dev Platform
2025-12-01
Crunchbase News
Highest Count Of New Unicorns Join Crunchbase Board In Over 3 Years As Exits Also Gain Steam
2025-10-15
Company data provided by crunchbase