Machine Learning Operations Lead jobs in United States
cer-icon
Apply on Employer Site
company-logo

Together AI · 10 hours ago

Machine Learning Operations Lead

positionUnited States
timeFull-time
remoteRemote
senioritySenior Level
money$160K/yr - $280K/yr
date5+ years exp

Together AI is building an advanced AI Inference & Model Shaping Platform. They are seeking an exceptional MLOps Engineering Lead to ensure excellence of their ML API offerings and to optimize operations for availability and reliability across services.

Artificial Intelligence (AI)Generative AIInternetIT InfrastructureOpen Source
check
H1B Sponsor Likelynote

Responsibilities

Own availability and performance SLAs for production inference and fine-tuning services across serverless and dedicated deployments
Own & improve testing, deployment, configuration management, and monitoring practices for multi-cluster ML infrastructure – partnering closely with Infra SREs
Build self-serve tooling and automation to reduce operational toil and enable internal users (MLOps, customer experience) and self-serve offerings
Define and enforce configuration best practices for inference engines (vLLM, tvLLM, Pulsar) to prevent runtime issues
Lead incident response, conduct postmortems, and drive reliability improvements
Hire, mentor, and grow an MLOps engineering team
Partner with infrastructure and ML engineering teams to improve system reliability and cost efficiency

Qualification

KubernetesML serving frameworksProduction SLAsLLM inference systemsTeam leadershipCross-functional influenceSelf-serve toolingCost optimizationOpen-source contributions

Required

5+ years operating production ML inference or training systems at scale
2+ years leading engineering teams, with experience building teams from scratch
Deep expertise with Kubernetes, multi-cluster orchestration, and ML serving frameworks
Strong track record owning production SLAs (e.g. availability, TTFT, TPS)
Experience with LLM inference serving systems (vLLM, TRT-LLM, or similar)
Ability to influence cross-functional teams and make deployment/architecture decisions

Preferred

Experience building internal developer platforms or self-serve tooling
Background in cost optimization for GPU infrastructure
Contributions to open-source ML infrastructure projects

Benefits

Health insurance
Equity
Other competitive benefits

Company

Together AI

twittertwittertwitter
company-logo
Together AI is a cloud-based platform designed for constructing open-source generative AI and infrastructure for developing AI models.
dateFounded in 2022
location
San Francisco, California, USA
people-size201-500 employees
web-link
https://www.together.ai

H1B Sponsorship

Together AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (17)
2024 (6)
2023 (3)

Funding

Current Stage
Growth Stage
Total Funding
$533.5M
Key Investors
Salesforce VenturesLux Capital
2025-02-20Series B· $305M
2024-03-13Series A· $106M
2023-11-29Series A· $102.5M

Leadership Team

leader-logo
Vipul Ved Prakash
Co-Founder & CEO
linkedin
leader-logo
Kae Ike Lim
Executive Assistant to Co-Founder and CEO
linkedin

Recent News

Morningstar.com
AI21 Labs and Together AI Partner to Expand Access to Open-Source Models
2025-11-27
prnasia.com
PEGATRON Strengthens AI Infrastructure Collaboration with Together AI and 5C for NVIDIA GB300 NVL72 and NVIDIA HGX B200 Liquid-Cooled Rack Deployment in U.S. Data Centers
2025-11-19
KrASIA
Coding tools Cursor and Windsurf found using Chinese AI in latest releases
2025-11-07
Company data provided by crunchbase