Cartesia · 3 months ago
Researcher, Evals
*HQ - San Francisco, CA
Full-time
Onsite
Mid Level
$220K/yr - $350K/yrCartesia is pioneering the next generation of AI with a focus on interactive intelligence. The Evaluations Lead will design evaluation frameworks that capture the reasoning and interaction capabilities of models, working at the intersection of research, product, and infrastructure to define what intelligence means in AI.
Artificial Intelligence (AI)Real TimeSoftware
Responsibilities
Identify and define key model capabilities and behaviors that matter for next-generation model evals
Develop and implement new evaluation pipelines with robust statistical analysis and clear reporting
Partner closely with model training and research teams to embed evaluation systems directly into model development loops
Prototype new user studies and behavioral experiments to ground evaluations in real-world use
Qualification
Required
Experience designing or implementing evaluation frameworks for generative models (audio, text, or multimodal)
Strong technical and analytical skills, ability to take open-ended research ideas and translate them into production-ready systems
Creativity in defining novel quantitative metrics for subjective or behavioral qualities
Excitement for building evaluation systems that bridge research and real-world use
Curiosity and rigor in equal measure; motivation driven by discovering how to measure meaningful progress in intelligent behavior
Preferred
Understanding of model alignment concepts and evaluation approaches
Benefits
Lunch, dinner, and snacks at the office
Fully covered medical, dental, and vision insurance for employees
401(k)
Relocation and immigration support
Your own personal Yoshi
Company
Cartesia
Cartesia provides real-time multimodal intelligence for all devices.
Founded in 2023
11-50 employees
H1B Sponsorship
Cartesia has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (2)
Funding
Current Stage
Early StageTotal Funding
$86MKey Investors
Kleiner PerkinsIndex Ventures
2025-03-11Series A· $64M
2024-12-12Seed· $22M
Leadership Team
Karan Goel
Founder / CEO
Arjun Desai
Co-Founder
Recent News
South China Morning Post
2025-11-26
2025-10-23
Company data provided by crunchbase