Weights & Biases · 3 days ago
CUDA Engineer- Weights & Biases
Weights & Biases, part of CoreWeave, is focused on creating a powerful end-to-end platform for AI development. The role involves engineering performant CUDA kernels with a focus on numerical correctness and efficiency, particularly in the context of training and inference with large models.
Artificial Intelligence (AI)Data VisualizationDeveloper ToolsGenerative AIMachine Learning
Responsibilities
Engineer performant CUDA kernels with a focus on both numerical correctness and efficiency
Profile and debug CUDA kernels
Understand common patterns and bottlenecks in CUDA programming
Work on efficient training and inference with LoRA adapters on top of large MoE models
Familiarize with common optimizations such as the Punica/S-LoRA kernels and Flash Attention
Learn fast and ship code effectively
Touch various parts of the stack including high-performance LLM tracing dashboards
Qualification
Required
Engineer performant CUDA kernels with a focus on both numerical correctness and efficiency
Comfortable with profiling and debugging
Strong understanding of common patterns and bottlenecks
Familiar with efficient training and inference with LoRA adapters on top of large MoE models
Familiar with common optimizations such as the Punica/S-LoRA kernels and Flash Attention
Understand the recent Thinking Machines blog on nondeterminism
Ability to learn fast and ship
Demonstrated ability in engineering, regardless of formal education or years of professional experience
Impressive, impactful accomplishments from past projects or roles
Preferred
Prior experience with model training (especially using RL) or shipping real-world agents
Benefits
Medical, dental, and vision insurance - 100% paid for by CoreWeave
Company-paid Life Insurance
Voluntary supplemental life insurance
Short and long-term disability insurance
Flexible Spending Account
Health Savings Account
Tuition Reimbursement
Ability to Participate in Employee Stock Purchase Program (ESPP)
Mental Wellness Benefits through Spring Health
Family-Forming support provided by Carrot
Paid Parental Leave
Flexible, full-service childcare support with Kinside
401(k) with a generous employer match
Flexible PTO
Catered lunch each day in our office and data center locations
A casual work environment
A work culture focused on innovative disruption
Company
Weights & Biases
Weights & Biases is a developer-first MLOps platform that builds machine learning performance visualization tools.
Funding
Current Stage
Growth StageTotal Funding
$250MKey Investors
NVIDIAInsight PartnersCoatue
2025-03-04Acquired
2023-09-01Secondary Market
2023-08-09Series Unknown· $50M
Recent News
2025-11-04
2025-11-01
Company data provided by crunchbase