xAI · 1 week ago
Hardcore Engineer - Pre-training Infrastructure
Palo Alto, CA
Full-time
Hybrid
Senior Level
$180K/yr - $440K/yrxAI is on a mission to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. The Hardcore Engineer will design, build, and implement large-scale distributed training systems, while optimizing GPU utilization and maintaining the codebase.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Design, build, and implement large-scale distributed training systems
Profiling, debugging, and optimizing multi-host GPU utilization
Hardware / Software / Algorithm co-design
Maintain and innovate on the codebase
Build tools to boost the productivity of the team
Qualification
Required
Experience in configuring and troubleshooting operating systems for maximum performance
Built scalable training framework for AI models in HPC clusters, including but not limited to scalable orchestration framework and tools
Experience with machine learning compilers and runtime such as XLA, MLIR, and Triton
Experience with distributed training strategies such as FSDP, Megatron, and pipeline parallelism
Experience with NCCL or custom communication libraries for performant communication collectives
Strong communication skills
Ability to concisely and accurately share knowledge with teammates
Hands-on contribution to the company's mission
Strong work ethic and prioritization skills
Company
xAI
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
Founded in 2023
11-50 employees
H1B Sponsorship
xAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageTotal Funding
$42.73BKey Investors
Neptune Digital AssetsSpaceXMorgan Stanley
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
2025-07-13Corporate Round· $5.32B
Leadership Team
Yuhuai Wu
Co-Founder
Toby Pohlen
Founding Member
Recent News
Analytics Insight: Latest AI, Crypto, Tech News & Analysis
2026-01-19
2026-01-19
2026-01-19
Company data provided by crunchbase