xAI · 6 days ago
AI Engineer & Researcher - GPU Kernel
xAI is a company focused on creating AI systems that enhance humanity's understanding of the universe. They are looking for an AI Engineer & Researcher to develop and optimize low-level CUDA kernel operations for advanced inference and training software, while also innovating new ideas to maximize GPU capabilities.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Developing and improving low-level CUDA kernel optimizations for state-of-the-art inference and training software stack
Profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight
Understanding GPU memory hierarchy and computation capabilities
Implementing the latest methods from the deep learning literature in low-level CUDA kernels
Innovating new ideas that bring us closer to the limits of a GPU
Qualification
Required
Strong communication skills
Experience with CUDA
Experience with CUTLASS
Proficiency in C/C++ and Python binding tools
Experience in developing and improving low-level CUDA kernel optimizations for inference and training software stack
Experience in profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight
Understanding of GPU memory hierarchy and computation capabilities
Ability to implement methods from deep learning literature in low-level CUDA kernels
Ability to innovate new ideas for GPU optimization
Experience in building high-performance GeMM CUDA kernels using Tensor cores or CUDA cores
Experience in implementing features for attention kernel
Comfortable with writing both forward and backward kernels
Experience in optimizing for memory-bound and compute-bound operations
Ability to reason about register pressure, shared-memory usage, and GPU utilization
Familiarity with techniques in optimizing inference and training workloads
Experience using pybind to integrate custom-written kernels into a framework, especially JAX/XLA
Company
xAI
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
H1B Sponsorship
xAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageTotal Funding
$42.73BKey Investors
Neptune Digital AssetsSpaceXMorgan Stanley
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
2025-07-13Corporate Round· $5.32B
Recent News
2026-01-11
Clean Technica
2026-01-11
Company data provided by crunchbase