Software Engineer - Large Scale Inference jobs in United States
info-icon
This job has closed.
company-logo

San Francisco Compute Company · 2 months ago

Software Engineer - Large Scale Inference

San Francisco Compute Company is building a liquid market for GPU offtake to mitigate risks associated with financing GPU clusters. The role involves developing and scaling software systems for inference workloads, optimizing compute utilization, and ensuring high-quality, affordable inference products.

Information TechnologyInternet
check
H1B Sponsorednote

Responsibilities

Quantify, optimize, and visualize the unit economics of inference
Design solutions to maximize compute utilization
Create automated compute purchasing software to optimally fulfill inference job demand
Design, build and deploy systems to dynamically scale inference for customer needs

Qualification

Cloud environmentsRustKubernetesTerraformFault tolerant systemsCommunicatorSoftware craftsmanshipMarket dynamics interestStartup experienceTeam collaboration

Required

You enjoy the craftsmanship of software
You're a thoughtful high-agency engineer
Have a deep appreciation for reliable fault tolerant systems
Are a strong communicator and work well with others

Preferred

Have previously worked at a startup
Have interest in market dynamics
Have experience in cloud environments
Have experience with vLLM
Are comfortable working in Rust
Have some Kubernetes or terraform experience

Benefits

Generous equity grant
Team members are offered a competitive salary along with equity in the company
Visa Sponsorships
We match 401(k) plans up to 4%
We offer competitive medical, dental, vision insurance for employees and dependents and cover 100% of premiums
We offer unlimited paid time off as well as 10+ observed holidays
We offer biological, adoptive, and foster parents paid time off to spend quality time with family
We cover lunch daily for employees
You can buy as many books for the office as you want

Company

San Francisco Compute Company

twittertwittertwitter
company-logo
Compute is a commodity. We think people should buy it like one.

Funding

Current Stage
Early Stage
Total Funding
$52M
Key Investors
Altman Capital
2025-11-26Series A· $40M
2024-07-16Series Unknown· $12M
Company data provided by crunchbase