Anthropic · 2 weeks ago
Technical Program Manager, Inference
San Francisco, CA
Full-time
Hybrid
Mid, Senior Level
$290K/yr - $365K/yr
4+ years expAnthropic is an AI safety and research company dedicated to creating reliable, interpretable, and steerable AI systems. The Technical Program Manager for Inference will serve as a bridge between inference systems and the broader organization, driving strategic initiatives around infrastructure adoption and deployment processes while ensuring coordination across teams.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Lead cross-functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams. Drive end-to-end planning for major infrastructure transitions including platform modernization and new tech adoption
Develop and maintain processes for inference capacity planning and optimization. Partner with engineering teams to track utilization metrics, identify bottlenecks, and coordinate with capacity teams on resource allocation and model deprecation strategies
Establish and enforce governance for deployment processes, defining clear policies for self-service versus managed deployments. Create and maintain service level agreements for different deployment types and ensure smooth launches across teams
Own and prioritize the inference deployment roadmap, working closely with engineering leadership to prioritize initiatives and manage dependencies. Provide visibility into upcoming changes and their organizational impact
Build strong relationships across research, engineering, and product teams to understand requirements and constraints. Translate technical complexities into clear updates for leadership and ensure alignment on priorities and timelines
Identify inefficiencies in current workflows and drive systematic improvements. Establish metrics and dashboards to track infrastructure health, capacity utilization, and deployment success rates
Qualification
Required
Several years of experience in technical program management, with proven success delivering complex infrastructure programs, preferably in ML/AI systems or large-scale distributed systems
Deep technical understanding of inference systems, or cloud infrastructure - enough to engage substantively with engineers and identify technical risks
Excel at creating structure and processes in ambiguous environments, bringing clarity to complex cross-team initiatives
Strong stakeholder management skills and can build trust with both technical and non-technical partners
Comfortable navigating competing priorities and using data to drive technical decisions
Experience with infrastructure scaling initiatives, hardware integrations, or deployment governance
Thrive in fast-paced environments and can balance strategic planning with tactical execution
Passionate about AI infrastructure and understand the unique challenges of deploying and scaling large language models
At least a Bachelor's degree in a related field or equivalent experience
Benefits
Equity and benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours
Company
Anthropic
Anthropic is an AI research company that focuses on the safety and alignment of AI systems with human values.
501-1000 employees
H1B Sponsorship
Anthropic has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (105)
2024 (13)
2023 (3)
2022 (4)
2021 (1)
Funding
Current Stage
Late StageTotal Funding
$33.74BKey Investors
Lightspeed Venture PartnersGoogleAmazon
2025-09-02Series F· $13B
2025-05-16Debt Financing· $2.5B
2025-03-03Series E· $3.5B
Leadership Team
Dario Amodei
CEO & Co-Founder
Daniela Amodei
President and co-founder
Recent News
2026-01-11
Insurance giant Allianz signs Claude Code deal with Anthropic | CIO
2026-01-11
Company data provided by crunchbase