xAI · 19 hours ago
Software Engineer - Applied Inference
Palo Alto, CA
Full-time
Onsite
Mid, Senior Level
$180K/yr - $440K/yrxAI is a company focused on creating AI systems to aid humanity in its pursuit of knowledge. They are seeking a Software Engineer - Applied Inference to ensure the reliability of inference services and develop custom debugging tools across the entire stack.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Ensure the reliability of inference services, targeting 100% uptime and a 0% error rate
Develop custom debugging tools to trace, replay, and fix all errors or crashes across the entire stack, from cluster orchestration to GPU kernels
Manage the autoscaling, continuous deployment, and feature rollout of inference services
Benchmark and monitor the performance of inference engines under various production workloads
Build CI/CD infrastructure for endpoint deployment, image publishing, and inference engines
Qualification
Required
Strong communication skills
Experience with Kubernetes
Experience with Buildkite / ArgoCD
Experience with Prometheus / Grafana / PagerDuty
Experience with Pulumi / Terraform
Experience with custom debugging and tracing tools
Experience with large-scale, high-concurrent production serving
Experience with testing, benchmarking, and the reliability of inference services
Experience with CI/CD infrastructure
Ability to ensure the reliability of inference services, targeting 100% uptime and a 0% error rate
Ability to develop custom debugging tools to trace, replay, and fix all errors or crashes across the entire stack
Ability to manage autoscaling, continuous deployment, and feature rollout of inference services
Ability to benchmark and monitor the performance of inference engines under various production workloads
Ability to build CI/CD infrastructure for endpoint deployment, image publishing, and inference engines
Benefits
Equity
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various other discounts and perks
Company
xAI
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
Founded in 2023
11-50 employees
H1B Sponsorship
xAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageTotal Funding
$42.73BKey Investors
Neptune Digital AssetsSpaceXMorgan Stanley
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
2025-07-13Corporate Round· $5.32B
Leadership Team
Toby Pohlen
Founding Member
Recent News
2026-01-18
2026-01-18
Company data provided by crunchbase