Baseten · 1 week ago
Senior Software Engineer - Infrastructure
United States
Full-time
Remote
Senior Level
$200K/yr - $270K/yr
5+ years expBaseten powers mission-critical inference for the world's most dynamic AI companies. As a Senior Infrastructure Software Engineer, you'll architect and lead the development of our ML inference platform, making key technical decisions to enable developers to deploy and scale ML models.
AI InfrastructureArtificial Intelligence (AI)Developer ToolsMachine LearningSoftwareSoftware Engineering
Responsibilities
Design and architect scalable infrastructure systems for our ML inference platform
Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
Drive enhancements to our inference orchestration layer for complex model deployments
Define monitoring strategies for model performance, latency, and resource utilization
Develop advanced solutions for GPU capacity management and throughput optimization
Establish infrastructure automation standards to streamline ML deployment workflows
Partner with other engineers to translate complex inference requirements into technical solutions
Make critical architectural decisions balancing performance with system reliability
Lead technical discussions and mentor junior engineers on infrastructure best practices
Contribute to long-term technical strategy and infrastructure roadmap
Qualification
Required
Bachelor's degree or higher in Computer Science or related field
5+ years experience building production infrastructure systems
Expert-level proficiency in Go, with Python experience a plus
Deep expertise with Kubernetes in production environments
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus
Advanced understanding of distributed systems concepts and performance tuning
Proven experience designing observability systems
Track record of leading technical initiatives and mentoring engineers
Experience with ML/AI workloads and MLOps platforms highly valued
Benefits
Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Company
Baseten
Baseten is an AI infrastructure company that integrates machine learning into business operations, production, and processes.
51-200 employees
H1B Sponsorship
Baseten has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (8)
2023 (1)
2020 (1)
Funding
Current Stage
Late StageTotal Funding
$585MKey Investors
BondGreylock
2026-01-20Series Unknown· $300M
2025-09-05Series D· $150M
2025-02-19Series C· $75M
Leadership Team
Aaron Relph
Design
Recent News
2026-01-23
2026-01-23
Company data provided by crunchbase