Baseten · 8 hours ago
Senior Software Engineer - Infrastructure
San Francisco, CA
Full-time
Onsite
Senior Level
$200K/yr - $270K/yr
5+ years expBaseten powers mission-critical inference for the world's most dynamic AI companies, and they are seeking a Senior Infrastructure Software Engineer to architect and lead the development of their ML inference platform. The role involves making key technical decisions for infrastructure that enables developers to deploy, scale, and monitor ML models with high performance and reliability.
Artificial Intelligence (AI)Developer ToolsMachine LearningSoftwareSoftware Engineering
Responsibilities
Design and architect scalable infrastructure systems for our ML inference platform
Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
Drive enhancements to our inference orchestration layer for complex model deployments
Define monitoring strategies for model performance, latency, and resource utilization
Develop advanced solutions for GPU capacity management and throughput optimization
Establish infrastructure automation standards to streamline ML deployment workflows
Partner with other engineers to translate complex inference requirements into technical solutions
Make critical architectural decisions balancing performance with system reliability
Lead technical discussions and mentor junior engineers on infrastructure best practices
Contribute to long-term technical strategy and infrastructure roadmap
Qualification
Required
Bachelor's degree or higher in Computer Science or related field
5+ years experience building production infrastructure systems
Expert-level proficiency in Go
Deep expertise with Kubernetes in production environments
Advanced understanding of distributed systems concepts and performance tuning
Proven experience designing observability systems
Track record of leading technical initiatives and mentoring engineers
Preferred
Python experience a plus
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus
Experience with ML/AI workloads and MLOps platforms highly valued
Benefits
Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Company
Baseten
Baseten is an AI infrastructure company that integrates machine learning into business operations, production, and processes.
51-200 employees
H1B Sponsorship
Baseten has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (8)
2023 (1)
2020 (1)
Funding
Current Stage
Late StageTotal Funding
$285MKey Investors
BondGreylock
2025-09-05Series D· $150M
2025-02-19Series C· $75M
2024-03-04Series B· $40M
Leadership Team
Aaron Relph
Design
Recent News
2025-12-13
Tech Startups - Tech News, Tech Trends & Startup Funding
2025-12-11
Tech Startups - Tech News, Tech Trends & Startup Funding
2025-12-11
Company data provided by crunchbase