Cohere · 9 hours ago
Software Engineer, Internal Infrastructure (North America)
New York, NY
Full-time
Hybrid
Entry, Mid, Senior Level, Lead/StaffCohere is on a mission to scale intelligence for humanity by training and deploying frontier AI models. The Software Engineer in the Internal Infrastructure team will build and operate Kubernetes GPU superclusters, collaborating closely with AI researchers to enhance infrastructure stability and efficiency.
Artificial Intelligence (AI)Generative AIMachine LearningNatural Language Processing
Responsibilities
Build and operate Kubernetes compute superclusters across multiple clouds
Partner with cloud providers to optimize infrastructure costs, performance, and reliability for AI workloads
Work closely with research teams to understand their infrastructure needs and identify ways to improve stability, performance, and efficiency of novel model training techniques
Design and build resilient, scalable systems for training AI models, focusing on creating intuitive user interfaces that empower researchers to self-serve to troubleshoot and resolve problems
Encourage software best practices across our company and participate in team processes such as knowledge sharing, reviews, and on-call
Qualification
Required
Deep experience running Kubernetes clusters at scale and/or scaling and troubleshooting Cloud Native infrastructure, including Infrastructure as Code
Strong programming skills in Go or Python
Self-directed and adaptable, and excel at identifying and solving key problems
Excellent communication skills and thrive in fast-paced environments
Draw motivation from building systems that help others be more productive
See mentorship, knowledge transfer, and review as essential prerequisites for a healthy team
Encourage software best practices across our company and participate in team processes such as knowledge sharing, reviews, and on-call
Preferred
Prefer contributing to Open Source solutions rather than building solutions from the ground up
Benefits
An open and inclusive culture and work environment
Work closely with a team on the cutting edge of AI research
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits, including a separate budget to take care of your mental health
100% Parental Leave top-up for up to 6 months
Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
6 weeks of vacation (30 working days!)
Company
Cohere
Cohere is an enterprise AI firm developing secure and private AI technology to address real-world business challenges.
Founded in 2019
201-500 employees
H1B Sponsorship
Cohere has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (14)
2023 (13)
2022 (5)
2021 (2)
Funding
Current Stage
Late StageTotal Funding
$1.71BKey Investors
Government of CanadaTiger Global ManagementIndex Ventures
2025-09-24Series D· $100M
2025-08-14Series D· $500M
2025-06-17Secondary Market
Leadership Team
Aidan Gomez
cofounder + ceo
Ivan Zhang
Co-Founder
Recent News
2025-12-27
2025-12-24
2025-12-20
Company data provided by crunchbase