Databricks · 1 day ago
Staff Technical Program Manager – GenAI Ops & Capacity Planning
Mountain View, CA
Full-time
Onsite
Lead/Staff
$172K/yr - $241K/yr
10+ years expDatabricks is a leading data and AI company focused on building and operating the best data and AI infrastructure platform. They are seeking a Staff Technical Program Manager to drive GenAI Operations and Capacity Planning for their large-scale LLM and GPU-backed platform, ensuring effective execution of operational initiatives and capacity management.
AnalyticsArtificial Intelligence (AI)Data IntegrationData ManagementData StorageInformation TechnologyMachine Learning
Responsibilities
Plan and execute day-0 launches of new LLM models on Databricks, ensuring production readiness across engineering, commercialization, go-to-market, legal and cloud service partners
Partner with AI/ML and platform engineering teams to operationalize LLM onboarding, rollout, and lifecycle management
Define and maintain launch checklists, operational runbooks, and success metrics for GenAI workloads
Own GPU and LLM capacity planning, forecasting, and allocation for GenAI workloads
Build and maintain SQL-driven analytical models and dashboards to forecast demand, track utilization, and surface capacity risks
Balance customer demand, growth trajectories, and contractual commitments to inform short- and medium-term capacity decisions
Track and drive efficient consumption of GPU and LLM capacity, identifying underutilization, contention, and inefficiencies
Define and monitor KPIs for utilization, efficiency, and reliability of GenAI platforms
Use data to recommend improvements to engineering roadmaps, operational processes, and cost optimization efforts
Execute governance mechanisms to ensure GenAI capacity usage aligns with contractual, financial, and compliance requirements
Produce clear, data-backed reporting for senior leaders on capacity health, utilization trends, and operational risks
Generate consumption reports, usage metrics reporting and share of wallet attestations
Ensure documentation, controls, and processes are audit-ready and consistently followed
Qualification
Required
10+ years of overall industry experience, including 7+ years in Technical Program Management
Experience leading cross-functional GenAI, AI/ML, or infrastructure programs from planning through launch and steady-state operations
Strong background in capacity planning, forecasting, and infrastructure analytics
Advanced SQL skills and hands-on experience building analytics, dashboards, and operational reporting
Ability to translate complex data into clear insights and recommendations for engineering and leadership stakeholders
Hands-on experience with at least one major cloud provider: AWS, Azure, or GCP
Familiarity with agile methodologies and program management tools such as Jira
Comfortable managing ambiguity, driving execution, and handling escalations when needed
Preferred
Master's degree or advanced technical degree
Experience operating LLM, GPU, or GenAI platforms in production environments
Background in cloud infrastructure, distributed systems, or platform engineering
Previous software or hardware development experience
Benefits
Comprehensive benefits and perks that meet the needs of all our employees
Eligibility for annual performance bonus
Equity
Company
Databricks
Databricks is a data and AI platform that unifies data engineering, analytics, and machine learning on a lakehouse architecture.
5001-10000 employees
H1B Sponsorship
Databricks has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (385)
2024 (319)
2023 (227)
2022 (222)
2021 (166)
2020 (64)
Funding
Current Stage
Late StageTotal Funding
$25.81BKey Investors
Counterpoint GlobalFranklin TempletonAndreessen Horowitz
2025-12-16Series Unknown· $4B
2025-09-08Series Unknown· $1B
2025-01-13Debt Financing· $5.25B
Leadership Team
Ali Ghodsi
CEO and Co-founder
David Conte
Chief Financial Officer
Recent News
2026-01-22
Company data provided by crunchbase