Apply on Employer Site

xAI · 19 hours ago

Software Engineer - Applied Inference

Palo Alto, CA

Full-time

Onsite

Mid, Senior Level

$180K/yr - $440K/yr

xAI is dedicated to creating AI systems that enhance understanding of the universe and support human knowledge. They are seeking a Software Engineer - Applied Inference to ensure the reliability of inference services and develop custom debugging tools while working within a highly motivated, hands-on team environment.

Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning

Growth Opportunities

H1B Sponsor Likely

Responsibilities

Ensure the reliability of inference services, targeting 100% uptime and a 0% error rate

Develop custom debugging tools to trace, replay, and fix all errors or crashes across the entire stack, from cluster orchestration to GPU kernels

Manage the autoscaling, continuous deployment, and feature rollout of inference services

Benchmark and monitor the performance of inference engines under various production workloads

Build CI/CD infrastructure for endpoint deployment, image publishing, and inference engines

Qualification

KubernetesCI/CD infrastructureCustom debugging toolsPrometheusTerraformPrioritization skillsCommunication skillsWork ethic

Required

Strong communication skills

Experience with Kubernetes

Experience with Buildkite / ArgoCD

Experience with Prometheus / Grafana / PagerDuty

Experience with Pulumi / Terraform

Experience with SGLang or open-source projects

Experience in ensuring the reliability of inference services

Experience in developing custom debugging tools

Experience in managing autoscaling, continuous deployment, and feature rollout of inference services

Experience in benchmarking and monitoring performance of inference engines

Experience in building CI/CD infrastructure for endpoint deployment, image publishing, and inference engines

Experience working on large-scale, high-concurrent production serving

Experience in testing, benchmarking, and reliability of inference services

Experience in CI/CD infrastructure

Benefits

Equity

Comprehensive medical, vision, and dental coverage

Access to a 401(k) retirement plan

Short & long-term disability insurance

Life insurance

Various other discounts and perks

Company

xAI

XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.

Founded in 2023

Palo Alto, California, USA

1001-5000 employees

https://x.ai

H1B Sponsorship

xAI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (1)

Funding

Current Stage

Late Stage

Total Funding

$42.73B

Key Investors

Valor Equity PartnersNeptune Digital AssetsSpaceX

2026-02-02Acquired

2026-01-06Series E· $20B

2025-12-11Secondary Market· $0.3M

Leadership Team

Greg Yang

Co-Founder

Yuhuai Wu

Co-Founder

Recent News

Irish Times

SpaceX IPO faces new questions after Musk’s AI merger

2026-02-09

Benzinga.com

Elon Musk Says SpaceX Prioritizing Self-Growing Moon City Over Mars, Cites Faster Timelines: 'Mission ... Remains The Same'

2026-02-09

Business Standard India

SpaceX to prioritise building 'self-growing city' on Moon, says Musk

2026-02-09

Company data provided by crunchbase