Vast.ai · 1 week ago
Senior Infrastructure Engineer
San Francisco, CA
Full-time
Onsite
Senior Level, Lead/Staff
$180K/yr - $300K/yrVast.ai is a company focused on democratizing and decentralizing AI computing. As a Senior Infrastructure Engineer, you will design and scale core systems for Vast.ai’s global GPU marketplace and collaborate with the engineering team to enhance the infrastructure.
Artificial Intelligence (AI)Cloud ComputingGPUMachine Learning
Responsibilities
Improve the backend systems that power Vast.ai’s compute marketplace
Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs
Develop scalable infrastructure for workload scheduling and resource management
Optimize pricing and marketplace logic for efficiency and transparency
Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
Collaborate with product and infrastructure teams to shape the future of decentralized compute
Qualification
Required
Experience building high-throughput backend systems or compute clouds
Familiarity with Docker, or custom scheduling frameworks
Understanding of GPU provisioning, driver management, and workload scheduling
Implemented or integrated usage-based billing and account credit systems
Knowledge of dynamic pricing, spot instances, or supply-demand balancing mechanisms
Experience designing secure, multi-tenant systems in cloud environments
Strong programming skills in Python and C++
Ability to write performant, maintainable, well-architected code
Comfortable designing schemas and queries for large-scale data systems (PostgreSQL preferred)
Preferred
Experience with GPU security, virtualization, or zero-trust compute isolation
Prior startup experience or end-to-end product ownership
Benefits
Comprehensive health, dental, vision, and life insurance
401(k) with company match
Meaningful early-stage equity
Onsite meals, snacks, and close collaboration with founders and tech leads
Ambitious, fast-paced startup culture where initiative is rewarded
Company
Vast.ai
Global GPU rental platform for saving 5-6X on GPU compute using one simple interface.
Founded in 2016
11-50 employees
Funding
Current Stage
Early StageTotal Funding
$4MKey Investors
DRW Venture Capital
2024-07-12Seed· $4M
Leadership Team
Travis Cannell
CMO
Recent News
Company data provided by crunchbase