DoorDash · 22 hours ago
Staff Software Engineer, ML Serving Platform
United States
Full-time
Remote
Senior Level, Lead/Staff
$131K/yr - $192K/yr
8+ years expDoorDash is building the world’s most reliable on-demand logistics engine, and they are seeking a Staff Software Engineer with deep expertise in ML model serving. This role involves designing and building systems for real-time predictions, collaborating with various teams to enhance the ML serving platform.
AppsDeliveryE-Commerce PlatformsFood DeliveryOnline Portals
Responsibilities
Scale richer models at low latency - Design serving systems that handle large, complex models while balancing cost, throughput, and strict latency SLOs
Bring modern inference optimizations into production - Operationalize advances from the ML serving ecosystem (e.g. efficient caching, attention optimizations, batching, quantization) to deliver better user experience, latency, and cost efficiency across our fleet
Enable platform-wide impact - Build abstractions and primitives that let serving improvements apply broadly across many workloads, rather than point solutions for individual models
Leverage and contribute to OSS - Apply the best of the open-source serving ecosystem and vendor solutions, and contribute improvements back where it helps the community
Drive cost & reliability - Design autoscaling and scheduling across heterogeneous hardware (GPU/TPU/CPU), with strong isolation, observability, and tail-latency control
Collaborate broadly - Partner with ML engineers, infra teams, external vendors, and open-source communities to ensure our serving stack evolves with the needs of the business
Raise the engineering bar - Establish metrics & processes that improve developer velocity, system reliability, and long-term maintainability
Qualification
Required
Have 8+ years of engineering experience, including building or operating large-scale, high-QPS ML serving systems
Bring deep familiarity with ML inference and serving ecosystems
Know how to leverage and extend open-source frameworks and evaluate vendor solutions pragmatically
Balance hands-on execution with long-term platform thinking, making sound trade-offs
Care deeply about reliability, performance, observability, and security in production systems
Lead by example - collaborating effectively, mentoring peers, and setting a high bar for craftsmanship
Preferred
GPU serving expertise - Experience with frameworks like NVIDIA Triton, TensorRT-LLM, ONNX Runtime, or vLLM, including hands-on use of KV caching, batching, and memory-efficient inference
Familiarity with deep learning frameworks (PyTorch, TensorFlow) and large language models (LLMs) such as GPT-OSS or BERT
Hands-on experience with Kubernetes/EKS, microservice architectures, and large-scale orchestration for inference workloads
Cloud experience (AWS, GCP, Azure) with a focus on scaling strategies, observability, and cost optimization
Prior contributions to OSS serving ecosystems (e.g., vLLM, Triton plugins, KServe) or active participation in developer communities
Benefits
401(k) plan with employer matching
16 weeks of paid parental leave
Wellness benefits
Commuter benefits match
Paid time off
Paid sick leave in compliance with applicable laws
Medical, dental, and vision benefits
11 paid holidays
Disability and basic life insurance
Family-forming assistance
Mental health program
Company
DoorDash
DoorDash is a food delivery platform that connects customers with local and national businesses. It is a sub-organization of DoorDash.
10001+ employees
H1B Sponsorship
DoorDash has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (530)
2024 (510)
2023 (413)
2022 (612)
2021 (439)
2020 (126)
Funding
Current Stage
Public CompanyTotal Funding
$5.22BKey Investors
Durable Capital PartnersT. Rowe PriceDarsana Capital Partners
2025-05-27Post Ipo Debt· $2.75B
2020-12-09IPO
2020-06-11Series H· $400M
Leadership Team
Tony Xu
CEO and Co-founder
Stanley Tang
Co-Founder / Chief Product Officer
Recent News
Business Insider
2026-01-07
2026-01-07
Deli Market News
2026-01-07
Company data provided by crunchbase