Apply on Employer Site

fal · 3 months ago

Staff Software Engineer, Compute

San Francisco

Full-time

Onsite

Senior Level, Lead/Staff

$180K/yr - $250K/yr

Fal is a company focused on building large scale computation platforms. They are seeking an experienced Staff Software Engineer to develop and maintain their core Python platform and infrastructure layer, ensuring efficient workload orchestration and resource management.

AI InfrastructureArtificial Intelligence (AI)Developer PlatformInformation TechnologyMachine Learning

H1B Sponsored

Responsibilities

Develop and maintain our core Python platform, which handles routing of requests, orchestration of AI workloads, GPU server capacity management, observability, authentication, rate limiting, and many others

Develop and maintain our infrastructure layer where we use Terraform, Ansible, and provider APIs to manage our fleet of GPU workers

Own K8s, FluxCD, Nomad, Prometheus, Thanos, Grafana, Loki, distributed networking storage, and other technologies that underpin our platform

Create the vision and lay the foundation for where our infrastructure should go in the next 1/2/5 years