Zyphra · 2 months ago
Product Infrastructure Engineer - Site Reliability
Palo Alto, CA
Full-time
Onsite
Mid LevelZyphra is an artificial intelligence company based in Palo Alto, California. The role involves designing and maintaining robust, observable, secure, and scalable systems that ensure the reliability of machine learning workloads and deployments.
Artificial Intelligence (AI)Cloud ComputingMachine LearningSoftware
Responsibilities
Building and improving observability systems (monitoring, logging, alerting)
Designing resilient build and deployment systems across research and production environments
Implementing secure release processes with strong auditability and rollback support
Collaborating closely with ML engineers, DevOps, and infra teams to improve system reliability and performance
Leading incident response, root-cause analysis, and postmortems with a focus on learning and prevention
Qualification
Required
Experience in high-performance compute environments, such as ML clusters or GPU farms
Background in infrastructure as code (e.g., Ansible, Terraform)
Familiarity with software release engineering with for ML/AI systems is a plus
Experience designing reliable environments for experimental workloads and reproducible runs
Knowledge of compliance and audit standards in deployment and system security
Experience with load testing, fault injection, and chaos engineering to harden systems under stress
Passion for building tooling that makes infrastructure invisible and reliable for end users
Preferred
Experience with infrastructure as code (e.g., Ansible, Terraform)
Prior work supporting ML/AI infrastructure, including GPU management and workload optimization
Exposure to backend development for ML model serving (e.g., vLLM, Ray, SGLang)
Experience working with cloud platforms such as AWS, Azure, or GCP
Familiarity with containers (Docker, Apptainer) and their integration with scheduling systems (Slurm, Kubernetes)
Benefits
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k)
Relocation and immigration support on a case-by-case basis
On-site meals prepared by a dedicated culinary team; Thursday Happy Hours
In-person team in Palo Alto, CA, with a collaborative, high-energy environment
Company
Zyphra
Zyphra is superintelligence research and product company based in San Francisco, California.
Founded in 2021
51-200 employees
H1B Sponsorship
Zyphra has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Growth StageTotal Funding
$100M2025-06-09Series A· $100M
2023-06-09Seed
2021-11-18Pre Seed
Recent News
2025-11-30
2025-11-27
Company data provided by crunchbase