Databricks · 6 days ago
Sr. Manager, Engineering - Model Serving
San Francisco, CA
Full-time
Onsite
Senior Level, Lead/Staff, Director/Executive
$217K/yr - $312K/yr
5+ years expDatabricks is a leading data and AI company, dedicated to enabling data teams to solve complex problems. The Senior Engineering Manager will lead the Model Serving team, overseeing the product experience and foundational infrastructure, while collaborating across various teams to enhance customer experience and operational efficiency.
AnalyticsArtificial Intelligence (AI)Data StorageInformation TechnologyMachine Learning
Responsibilities
Lead, mentor, and grow a high-performing engineering team responsible for both the customer-facing Model Serving product and its foundational infrastructure — covering runtime, APIs, scaling, reliability, and integrations
Define and own the product and technical roadmap for Model Serving, balancing customer experience, functionality, and foundational investments across deployment, inference, monitoring, and scaling
Collaborate closely with product, research, platform, and infrastructure teams to drive end-to-end delivery — from ideation and prioritization to launch and operation
Ensure Model Serving meets stringent SLAs, SLOs, and performance and reliability goals, continuously improving operational efficiency and customer experience
Drive architectural decisions and product design around latency, throughput, autoscaling, GPU/CPU placement, and cost optimization
Advocate for customer needs through direct engagement, ensuring engineering decisions translate to clear product impact
Promote best practices in code quality, testing, observability, and operational readiness
Foster a culture of excellence, inclusion, and continuous improvement across the team
Partner with recruiting to attract, hire, and develop top-tier engineering talent
Qualification
Required
5+ years of experience in technical leadership or management
Proven track record building and operating large-scale distributed systems, preferably real-time or low-latency APIs
Deep understanding of real-time serving systems
Experience driving architectural design and operational excellence for production systems with measurable SLAs and SLOs
Familiarity with CPU/GPU performance optimization, concurrency, caching, and scalability concepts
Excellent collaboration and communication skills across engineering, product, and research organizations
Ability to lead teams through ambiguity and deliver complex, cross-functional projects
BS in Computer Science
Preferred
Masters or PhD in Computer Science
Benefits
Annual performance bonus
Equity
Company
Databricks
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture.
5001-10000 employees
H1B Sponsorship
Databricks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (385)
2024 (319)
2023 (227)
2022 (222)
2021 (166)
2020 (64)
Funding
Current Stage
Late StageTotal Funding
$25.81BKey Investors
Counterpoint GlobalFranklin TempletonAndreessen Horowitz
2025-12-16Series Unknown· $4B
2025-09-08Series Unknown· $1B
2025-01-13Debt Financing· $5.25B
Leadership Team
Ali Ghodsi
CEO and Co-founder
David Conte
Chief Financial Officer
Recent News
thefly.com
2026-01-13
Company data provided by crunchbase