Cohere · 1 month ago
Technical Program Manager, Infrastructure & Capacity Management
New York
Full-time
Onsite
Senior Level
5+ years expCohere is a company focused on scaling intelligence to serve humanity through AI systems. They are seeking an experienced Technical Program Manager to manage the lifecycle of compute resources and lead programs within the infrastructure space, collaborating with various teams to ensure project success.
Artificial Intelligence (AI)Foundational AIGenerative AIMachine LearningNatural Language Processing
Responsibilities
Coordinate with internal and external teams (cloud providers, GPU manufacturers etc.) to manage the full lifecycle of compute resources, with a heavy emphasis on GPUs
Lead end-to-end programs within the infrastructure space from planning and execution to cross-functional coordination and stakeholder management
Collaborate directly with technical and non-technical teams to set, track, and manage timelines, deliverables, budgets, scope etc
Manage various overlapping projects and programs, ruthlessly prioritizing asks, to ensure that the company’s top priorities are met
Work with leadership on anticipating and planning capacity needs across the company, and turning these needs into practical execution plans on how capacity is allocated, tracked, and managed
Deliver clear, timely, and consistent updates across engineering, leadership, and non–technical teams on the monthly container releases and wider model launches
Qualification
Required
You have 5+ years of experience as a Technical Program Manager
You have 3+ years working with infrastructure teams, and have a solid understanding of the challenges with project and program management in this space
You know how to use Github & Grafana, can read Terraform, and are generally comfortable with onboarding and diving into new technologies
You have practical experience, either in a hands-on role or as a TPM, with full lifecycle management of compute resources (GPUs, CPUs, VMs etc.)
You have a blend of experience working in the intersection of software, hardware, and machine learning – particularly with GPUs used for ML training and inference
You have hands-on experience with coordinating large-scale, company-wide programs within a deeply technical space
You have worked in highly dynamic, fast-paced environments, requiring striking a balance between speed and structure
Preferred
You have experience with managing projects and programs related to serving and efficiency of LLMs
You have past experience in a technical role, such as infrastructure engineer, software engineer, machine learning engineer etc
Benefits
An open and inclusive culture and work environment
Work closely with a team on the cutting edge of AI research
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits, including a separate budget to take care of your mental health
100% Parental Leave top-up for up to 6 months
Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
6 weeks of vacation (30 working days!)
Company
Cohere
Cohere is an enterprise AI firm developing secure and private AI technology to address real-world business challenges.
201-500 employees
H1B Sponsorship
Cohere has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (14)
2023 (13)
2022 (5)
2021 (2)
Funding
Current Stage
Late StageTotal Funding
$1.71BKey Investors
Government of CanadaTiger Global ManagementIndex Ventures
2025-09-24Series D· $100M
2025-08-14Series D· $500M
2025-06-17Secondary Market
Leadership Team
Aidan Gomez
cofounder + ceo
Ivan Zhang
Co-Founder
Recent News
Beyond Bylines
2026-01-11
2026-01-06
Crunchbase News
2026-01-06
Company data provided by crunchbase