Member of Technical Staff, Training Performance Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Cohere · 1 day ago

Member of Technical Staff, Training Performance Engineer

positionNew York, NY
timeFull-time
remoteHybrid
seniorityMid Level

Cohere is a company dedicated to scaling intelligence to serve humanity through advanced AI systems. The Performance Engineer in the Pre-Training team will optimize the performance of language models, focusing on improving training metrics and removing performance bottlenecks.

Artificial Intelligence (AI)Generative AIMachine LearningNatural Language Processing
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Design and write high-performant and scalable software for training
Understand architectural modifications and design choices and their effects on training throughput and quality
Write low-level CUDA, triton kernels to squeeze every last bit of performance from our accelerators
Research, implement, and experiment with ideas on our supercompute and data infrastructure
Learn from and work with the best researchers in the field

Qualification

Software engineeringPythonCUDAJAXPytorchDistributed trainingLow-level kernel designNatural language processingTeam collaboration

Required

Extremely strong software engineering skills
Proficiency in Python and related ML frameworks such as JAX, Pytorch and XLA/MLIR
Experience writing kernels for GPUs using CUDA, triton, etc
Experience using large-scale distributed training strategies
Familiarity with autoregressive sequence models, such as Transformers

Preferred

paper at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)

Benefits

An open and inclusive culture and work environment
Work closely with a team on the cutting edge of AI research
Weekly lunch stipend, in-office lunches & snacks
Full health and dental benefits, including a separate budget to take care of your mental health
100% Parental Leave top-up for up to 6 months
Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
6 weeks of vacation (30 working days!)

Company

Cohere

twittertwittertwitter
company-logo
Cohere is an enterprise AI firm developing secure and private AI technology to address real-world business challenges.
dateFounded in 2019
location
Toronto, Ontario, CAN
people-size201-500 employees
web-link
https://cohere.com

H1B Sponsorship

Cohere has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (14)
2023 (13)
2022 (5)
2021 (2)

Funding

Current Stage
Late Stage
Total Funding
$1.71B
Key Investors
Government of CanadaTiger Global ManagementIndex Ventures
2025-09-24Series D· $100M
2025-08-14Series D· $500M
2025-06-17Secondary Market

Leadership Team

leader-logo
Aidan Gomez
cofounder + ceo
linkedin
leader-logo
Ivan Zhang
Co-Founder
linkedin

Recent News

Financial Post
Joly presses Lockheed for jobs as crucial F-35 decision nears
2026-01-06
Crunchbase News
Crunchbase Predicts: 15 Companies That Could Go Public In 2026 As The IPO Market Gains Momentum
2026-01-06
Digiday
Here are the biggest moments in AI for publishers in 2025
2025-12-27
Company data provided by crunchbase