Anthropic · 14 hours ago
Technical Program Manager, Inference Performance
Seattle, WA
Full-time
Hybrid
Mid, Senior Level
$290K/yr - $365K/yr
4+ years expAnthropic is a public benefit corporation focused on creating reliable and beneficial AI systems. The Technical Program Manager for Inference will coordinate strategic initiatives across inference runtime and accelerator performance, ensuring effective collaboration between teams and successful model launches.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Systems Integration & Coordination: Lead cross-functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams. Drive end-to-end planning for major infrastructure transitions including platform modernization and new tech adoption
Performance & Efficiency: Partner with engineering teams to identify optimization opportunities, track performance metrics, and prioritize work that unlocks capacity gains. Coordinate across runtime and accelerator layers to ensure efficiency wins ship without compromising reliability
Launch Coordination: Drive end-to-end readiness for model and feature launches across multiple hardware platforms. Establish processes for cross-platform validation, manage launch timelines, and ensure smooth handoffs between runtime, accelerator, and downstream teams
Strategic Planning: Own and prioritize the inference deployment roadmap, working closely with engineering leadership to prioritize initiatives and manage dependencies. Provide visibility into upcoming changes and their organizational impact
Stakeholder Communication: Build strong relationships across research, engineering, and product teams to understand requirements and constraints. Translate technical complexities into clear updates for leadership and ensure alignment on priorities and timelines
Process Improvement: Identify inefficiencies in current workflows and drive systematic improvements. Establish metrics and dashboards to track infrastructure health, capacity utilization, and deployment success rates
Qualification
Required
Several years of experience in technical program management, with proven success delivering complex infrastructure programs, preferably in ML/AI systems or large-scale distributed systems
Deep technical understanding of inference systems, compilers, or hardware accelerators to engage substantively with engineers and identify technical risks
Excel at creating structure and processes in ambiguous environments, bringing clarity to complex cross-team initiatives
Strong stakeholder management skills and can build trust with both technical and non-technical partners
Comfortable navigating competing priorities and using data to drive technical decisions
Experience with infrastructure scaling initiatives, hardware integrations, or deployment governance
Thrive in fast-paced environments and can balance strategic planning with tactical execution
Passionate about AI infrastructure and understand the unique challenges of deploying and scaling large language models
At least a Bachelor's degree in a related field or equivalent experience
Benefits
Optional equity donation matching
Generous vacation and parental leave
Flexible working hours
Company
Anthropic
Anthropic is an AI research company that focuses on the safety and alignment of AI systems with human values.
501-1000 employees
H1B Sponsorship
Anthropic has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (105)
2024 (13)
2023 (3)
2022 (4)
2021 (1)
Funding
Current Stage
Late StageTotal Funding
$33.74BKey Investors
Lightspeed Venture PartnersGoogleAmazon
2025-09-02Series F· $13B
2025-05-16Debt Financing· $2.5B
2025-03-03Series E· $3.5B
Leadership Team
Dario Amodei
Co-Founder and CEO
Daniela Amodei
President and co-founder
Recent News
2026-02-04
2026-02-04
Company data provided by crunchbase