AI Researcher (Multimodal Perception Models) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tavus · 1 month ago

AI Researcher (Multimodal Perception Models)

positionNew York, NY
timeFull-time
remoteHybrid
senioritySenior Level

Tavus is a research lab pioneering human computing, focused on building AI Humans that enable meaningful conversations between people and machines. The AI Researcher will conduct research on multimodal conversational intelligence and collaborate with the Applied ML team to implement their findings in production systems.

Artificial Intelligence (AI)Developer PlatformGenerative AISoftwareVideo
check
H1B Sponsor Likelynote

Responsibilities

Conduct research on Foundational Multimodal Models in the context of Conversational Avatars (e.g., Neural Avatars, Talking-Heads)
Model video, audio, and language sequences using Autoregressive, Predictive Architectures (e.g., V-JEPA), and/or Diffusion paradigms with an emphasis on temporal and sequential data rather than static images
Collaborate with the Applied ML team to bring your work to life in production systems
Stay at the cutting edge of multimodal learning and help us define what “cutting edge” means next

Qualification

PhD in relevant fieldDeep Learning expertiseProgramming in PyTorchSequence modelingLarge model trainingResearch publicationsGenerative AI knowledgeSoftware engineering practicesCuriosityFlexibility

Required

A PhD (or near completion) in a relevant field, or equivalent hands-on research experience
Experience modeling human behavior and generation (facial expressions, affect, or speech). Ideally in conversational or interactive settings
Deep understanding of sequence modeling in video/audio/language domains
Familiarity with large model training, especially LLMs or VLMs
Strong background in Deep Learning (from Transformers to Diffusion Models) and how to make them work in practice
Excellent programming skills, especially in PyTorch

Preferred

Publications in top-tier conferences like CVPR, ICCV, NeurIPS, ECCV, or ACMMM
Broader understanding of generative AI and multimodal architectures
Familiarity with software engineering best practices
Curiosity and a flexible mindset — you like building and experimenting

Benefits

Flexible work schedule
Unlimited PTO
Competitive healthcare
Gear stipends

Company

Tavus

twittertwittertwitter
company-logo
Tavus develops AI humans that remember and empathize, enabling seamless transitions across chat, voice, and video.
dateFounded in 2020
location
San Francisco, California, USA
people-size51-200 employees
web-link
https://www.tavus.io

H1B Sponsorship

Tavus has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)

Funding

Current Stage
Growth Stage
Total Funding
$64.22M
Key Investors
CRVScale Venture PartnersSequoia Capital
2025-11-12Series B· $40M
2023-08-29Series A· $18M
2023-03-20Seed· $6.1M

Leadership Team

leader-logo
Hassaan Raza
Co-Founder / CEO
linkedin
leader-logo
Quinn Favret
Co-Founder, COO
linkedin

Recent News

Business Wire
Tavus Announces AI Santa 2.0: The World’s First Emotionally Intelligent Holiday PAL
2025-12-10
TechCrunch
AI startup Tavus founder says users talk to its AI Santa ‘for hours’ per day
2025-12-10
Sourcery
CEO Bezos, Alex Karp, Elad Gil
2025-11-21
Company data provided by crunchbase