Apply on Employer Site

Inflection AI · 14 hours ago

Senior DevOps Engineer (AI & Cloud Infrastructure)

Palo Alto, CA

Full-time

Onsite

Senior Level

$175K/yr - $250K/yr

5+ years exp

Inflection AI is dedicated to harnessing the power of AI to enhance human well-being and productivity. They are seeking a Senior DevOps Engineer to design, deploy, and operate their cloud and AI infrastructure, focusing on the reliability and performance of GPU-enabled platforms for large-scale AI applications.

Artificial Intelligence (AI)ChatbotFoundational AIGenerative AIInformation TechnologyMachine Learning

H1B Sponsored

Responsibilities

Architect, deploy, and operate large-scale LLM inference servers and AI applications with a focus on low latency, high availability, and production reliability

Design, provision, and maintain complex cloud architectures across Azure and AWS, including storage, compute, networking, databases, and native LLM services

Manage GPU-enabled Kubernetes clusters and Slurm-based HPC environments, optimizing resource allocation for AI training and inference workloads

Deploy and operate core Kubernetes infrastructure components and operators (GPU operators, ingress controllers, service meshes, CNIs, CSIs, and storage drivers)

Build scalable infrastructure-as-code and deployment workflows using Terraform, Helm, Kustomize, ArgoCD, and GitOps best practices

Design and maintain centralized observability systems using Prometheus, Grafana, Clickhouse, and cloud-native monitoring tools

Participate in on-call rotations, lead incident response, perform post-mortems, and continuously improve system reliability and SLAs

Qualification

AzureAWSKubernetesLarge Language ModelsTerraformPrometheusGrafanaPythonBashGitOpsIncident Response

Required

5+ years of hands-on experience in DevOps, Site Reliability Engineering, or ML Infrastructure supporting high-scale, production systems

Deep expertise in Azure and AWS, including storage, compute, networking, databases, and cloud-native monitoring services

Strong Kubernetes administration experience, including GPU scheduling, operator deployment, and management of core infrastructure components; experience with Slurm is highly desirable

Proven experience deploying, scaling, and operating Large Language Models (LLMs) and inference engines such as vLLM, TGI, or Triton

Strong experience with modern DevOps tooling: Terraform, Helm, Kustomize, ArgoCD, GitHub Actions or GitLab CI, Prometheus, Grafana, and Clickhouse

Advanced scripting and automation skills in Python and Bash, with the ability to debug complex distributed systems and optimize performance at scale

Demonstrated ability to troubleshoot LLM servers, Kubernetes workloads, GPU utilization, and cloud infrastructure bottlenecks

Have a bachelor's degree or equivalent in a related field to the offered position requirements

Benefits

Diverse medical, dental and vision options

401k matching program

Unlimited paid time off

Parental leave and flexibility for all parents and caregivers

Support of country-specific visa needs for international employees living in the Bay Area

Company

Inflection AI

Inflection AI is a public benefit corporation leveraging its world class LLM to build an AI platform focused on the needs of the enterprise.

Founded in 2022

Palo Alto, California, USA

51-200 employees

https://inflection.ai

H1B Sponsorship

Inflection AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (2)

2024 (1)

2023 (2)