Together AI · 2 weeks ago
Machine Learning, Platform Engineer
San Francisco, CA
Full-time
Hybrid
Senior Level
$160K/yr - $250K/yr
5+ years expTogether AI is a research-driven artificial intelligence company focused on lowering the cost of modern AI systems. The role involves building a container platform, optimizing autoscaling, and improving model performance while ensuring a great developer experience.
AI InfrastructureArtificial Intelligence (AI)Generative AIInternetIT InfrastructureOpen Source
Responsibilities
New hires may work on multi-cluster orchestration, portfolio optimization, predictive autoscaling, control panes, model bring-up, model optimization, APIs for managing deployments, inference worker SDKs, and CLI tools
Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
Partner with product teams to understand functional requirements and deliver solutions that meet business needs
Write clear, well-tested, and maintainable software and IaC for both new and existing systems
Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
Qualification
Required
5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems
Experience running serverless inference platforms, doing model bring-up on short notice, being on call, or running a cloud provider is a very big plus
Good taste and ability to thoughtfully discuss how what you've built has failed over time
Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
Excellent understanding of low level operating systems concepts including concurrency, networking and storage, performance and scale
Expert-level programmer in one or more of Python, Golang, Rust, C++, or Haskell
Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform
Experience with Kubernetes internals or other container orchestration systems
Sound judgement for when to use and when to not use LLMs for code
Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
Writing-heavy roles or companies are a plus
Benefits
Competitive compensation
Startup equity
Health insurance
Other competitive benefits
Company
Together AI
Together AI is a cloud-based platform designed for constructing open-source generative AI and infrastructure for developing AI models.
201-500 employees
H1B Sponsorship
Together AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (19)
2024 (6)
2023 (3)
Funding
Current Stage
Growth StageTotal Funding
$533.5MKey Investors
Salesforce VenturesLux Capital
2025-02-20Series B· $305M
2024-03-13Series A· $106M
2023-11-29Series A· $102.5M
Leadership Team
Vipul Ved Prakash
Co-Founder & CEO
Kae Ike Lim
Executive Assistant to Co-Founder and CEO
Recent News
Dynamic Business
2026-01-20
2025-11-27
Company data provided by crunchbase