Apply on Employer Site

Weights & Biases · 4 days ago

Sr. Engineering Manager, Inference - Weights & Biases

Sunnyvale, CA

Full-time

Hybrid

Senior Level

$188K/yr - $303K/yr

7+ years exp

Weights & Biases, acquired by CoreWeave, is creating a powerful end-to-end platform for AI development and deployment. The Senior Engineering Manager for the W&B Inference team will lead efforts to productize and operate the inference offering while ensuring a reliable and developer-friendly experience within the W&B platform.

AI InfrastructureArtificial Intelligence (AI)Data VisualizationDeveloper ToolsGenerative AIMachine Learning

Comp. & Benefits

No H1B

U.S. Citizen Only

Responsibilities

Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience

Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact

Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality

Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product

Guide the design and delivery of application-layer enhancements such as tracing and tool call handling

Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints

Create clarity in complex, cross-functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams

Build a culture of ownership, technical excellence, and continuous improvement within the engineering team

Qualification

Distributed systemsEngineering leadershipService reliabilityDeveloper platformsAPI designCloud infrastructureObservabilityCommunication skillsProblem-solvingTeam collaboration

Required

7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services

Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations

Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity

Skilled at leading engineering teams through ambiguous, multi-stakeholder projects with strong communication and alignment

Deep empathy for ML practitioners and platform developers, with a drive to improve reliability, reduce friction, and elevate the developer experience