AI Fund · 2 months ago
Senior Software Engineer - Infrastructure
San Francisco, CA
Full-time
Onsite
Senior Level
5+ years expAI Fund is focused on powering inference for leading AI companies, and they are seeking a Senior Infrastructure Software Engineer to architect and lead the development of their ML inference platform. The role involves making key technical decisions and optimizing infrastructure for high performance and reliability in deploying and monitoring ML models.
Artificial Intelligence (AI)
Responsibilities
Design and architect scalable infrastructure systems for our ML inference platform
Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
Drive enhancements to our inference orchestration layer for complex model deployments
Define monitoring strategies for model performance, latency, and resource utilization
Develop advanced solutions for GPU capacity management and throughput optimization
Establish infrastructure automation standards to streamline ML deployment workflows
Partner with other engineers to translate complex inference requirements into technical solutions
Make critical architectural decisions balancing performance with system reliability
Lead technical discussions and mentor junior engineers on infrastructure best practices
Contribute to long-term technical strategy and infrastructure roadmap
Qualification
Required
Bachelor's degree or higher in Computer Science or related field
5+ years experience building production infrastructure systems
Expert-level proficiency in Go, with Python experience a plus
Deep expertise with Kubernetes in production environments
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus
Advanced understanding of distributed systems concepts and performance tuning
Proven experience designing observability systems
Track record of leading technical initiatives and mentoring engineers
Experience with ML/AI workloads and MLOps platforms highly valued
Benefits
100% coverage of medical, dental, and vision insurance for employee and dependents
Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
Company
AI Fund
AI Fund is a VC firm made up of AI pioneers, operators, entrepreneurs, and investors, supported by LPs such as NEA, Sequoia and Greylock.
11-50 employees
H1B Sponsorship
AI Fund has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
2020 (1)
Funding
Current Stage
Early StageLeadership Team
Eva Wang
Partner, COO & GC
Andrew Ng
Managing General Partner
Recent News
vcnewsdaily.com
2026-02-04
EIN Presswire
2026-02-04
2026-02-03
Company data provided by crunchbase