Databricks · 1 day ago
Senior Software Engineer, Model Serving
United States
Full-time
Remote
Senior Level
$166K/yr - $225K/yr
5+ years expDatabricks is a data and AI company passionate about enabling data teams to solve the world's toughest problems. They are seeking a Senior Software Engineer to shape the product experience and foundational infrastructure of their Model Serving product, focusing on designing systems for high-throughput and low-latency inference.
AnalyticsArtificial Intelligence (AI)Data StorageInformation TechnologyMachine Learning
Responsibilities
Design and implement core systems and APIs that power Databricks Model Serving, ensuring scalability, reliability, and operational excellence
Drive architectural decisions and trade-offs to optimize performance, throughput, autoscaling, and operational efficiency for CPU and GPU serving workloads
Contribute directly to key components across the serving infrastructure — from model container builds and deployment workflows to runtime systems like routing, caching, observability, and intelligent autoscaling — ensuring smooth and efficient operations at scale
Collaborate cross-functionally with product, platform, and research teams to translate customer needs into reliable and performant systems
Lead technical initiatives that improve latency, availability, and cost-effectiveness across both customer-facing and foundational serving layers
Establish best practices for code quality, testing, and operational readiness, and mentor other engineers through design reviews and technical guidance
Qualification
Required
5+ years of experience building and operating large-scale distributed systems
Experience in model serving, inference systems, or related infrastructure (e.g., routing, scheduling, autoscaling, and observability)
Strong foundation in algorithms, data structures, and system design as applied to large-scale, low-latency serving systems
Proven ability to deliver technically complex, high-impact initiatives that create measurable customer or business value
Experience building architecture for large-scale, performance-sensitive CPU/GPU inference systems
Strong communication skills and ability to collaborate across teams in fast-moving environments
Customer-focused mindset with the ability to align implementation details with product goals
Passion for mentoring, growing engineers, and fostering technical excellence
Benefits
Annual performance bonus
Equity
Company
Databricks
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture.
5001-10000 employees
H1B Sponsorship
Databricks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (385)
2024 (319)
2023 (227)
2022 (222)
2021 (166)
2020 (64)
Funding
Current Stage
Late StageTotal Funding
$25.81BKey Investors
Counterpoint GlobalFranklin TempletonAndreessen Horowitz
2025-12-16Series Unknown· $4B
2025-09-08Series Unknown· $1B
2025-01-13Debt Financing· $5.25B
Leadership Team
Ali Ghodsi
CEO and Co-founder
David Conte
Chief Financial Officer
Recent News
Crunchbase News
2026-01-09
2026-01-09
Company data provided by crunchbase