CUDA Engineer- Weights & Biases jobs in United States
cer-icon
Apply on Employer Site
company-logo

Weights & Biases · 3 days ago

CUDA Engineer- Weights & Biases

Weights & Biases, part of CoreWeave, is focused on creating a powerful end-to-end platform for AI development. The role involves engineering performant CUDA kernels with a focus on numerical correctness and efficiency, particularly in the context of training and inference with large models.

Artificial Intelligence (AI)Data VisualizationDeveloper ToolsGenerative AIMachine Learning
check
Comp. & Benefits
badNo H1BnoteU.S. Citizen Onlynote

Responsibilities

Engineer performant CUDA kernels with a focus on both numerical correctness and efficiency
Profile and debug CUDA kernels
Understand common patterns and bottlenecks in CUDA programming
Work on efficient training and inference with LoRA adapters on top of large MoE models
Familiarize with common optimizations such as the Punica/S-LoRA kernels and Flash Attention
Learn fast and ship code effectively
Touch various parts of the stack including high-performance LLM tracing dashboards

Qualification

CUDA programmingModel trainingPerformance optimizationReinforcement Learning (RL)LoRA adaptersKubernetesFastAPIDebuggingProfilingTeam collaboration

Required

Engineer performant CUDA kernels with a focus on both numerical correctness and efficiency
Comfortable with profiling and debugging
Strong understanding of common patterns and bottlenecks
Familiar with efficient training and inference with LoRA adapters on top of large MoE models
Familiar with common optimizations such as the Punica/S-LoRA kernels and Flash Attention
Understand the recent Thinking Machines blog on nondeterminism
Ability to learn fast and ship
Demonstrated ability in engineering, regardless of formal education or years of professional experience
Impressive, impactful accomplishments from past projects or roles

Preferred

Prior experience with model training (especially using RL) or shipping real-world agents

Benefits

Medical, dental, and vision insurance - 100% paid for by CoreWeave
Company-paid Life Insurance
Voluntary supplemental life insurance
Short and long-term disability insurance
Flexible Spending Account
Health Savings Account
Tuition Reimbursement
Ability to Participate in Employee Stock Purchase Program (ESPP)
Mental Wellness Benefits through Spring Health
Family-Forming support provided by Carrot
Paid Parental Leave
Flexible, full-service childcare support with Kinside
401(k) with a generous employer match
Flexible PTO
Catered lunch each day in our office and data center locations
A casual work environment
A work culture focused on innovative disruption

Company

Weights & Biases

company-logo
Weights & Biases is a developer-first MLOps platform that builds machine learning performance visualization tools.

Funding

Current Stage
Growth Stage
Total Funding
$250M
Key Investors
NVIDIAInsight PartnersCoatue
2025-03-04Acquired
2023-09-01Secondary Market
2023-08-09Series Unknown· $50M

Leadership Team

leader-logo
Chris Van Pelt
Co-Founder & CISO
linkedin
leader-logo
Shawn Lewis
Founder/CTO
linkedin
Company data provided by crunchbase