Member of Technical Staff, Large Generative Models jobs in United States
cer-icon
Apply on Employer Site
company-logo

Mirage · 1 month ago

Member of Technical Staff, Large Generative Models

Mirage is the leading AI short-form video company, focused on redefining video creation, production, and editing. They are seeking a Research Engineer to advance multimodal video diffusion models, conduct novel research, and develop new training techniques to enhance video generation capabilities.

Artificial Intelligence (AI)Generative AISoftware

Responsibilities

Design and implement novel architectures for large-scale video and multimodal diffusion models
Develop new approaches to multimodal fusion, temporal modeling, and video control
Research temporal video editing techniques and controllable generation
Research and validate scaling laws for video generation models
Create new loss functions and training objectives for improved generation quality
Drive rapid experimentation with model architectures and training strategies
Validate research directly through product deployment and user feedback
Train and optimize models at massive scale (10s-100s of billions of parameters)
Develop sophisticated distributed training approaches using FSDP, DeepSpeed, Megatron-LM
Design and implement model surgery techniques (pruning, distillation, quantization)
Create new approaches to memory optimization and training efficiency
Research techniques for improving training stability at scale
Conduct systematic empirical studies of architecture and optimization choices
Advance state-of-the-art in video model architecture design and optimization
Develop new approaches to temporal modeling for video generation
Create novel solutions for multimodal learning and cross-modal alignment
Research and implement new optimization techniques for generative modeling and sampling
Design and validate new evaluation metrics for generation quality
Systematically analyze and improve model behavior across different regimes

Qualification

Generative modelingDeep learningModel trainingDistributed trainingVideo generationOptimization techniquesEmpirical researchSoftware engineeringAnalytical skillsCollaboration

Required

Master's or PhD in Computer Science, Machine Learning, or related field
Track record of research contributions at top ML conferences (NeurIPS, ICML, ICLR)
Demonstrated experience implementing and improving upon state-of-the-art architectures
Deep expertise in generative modeling approaches (diffusion, autoregressive, VAEs, etc.)
Strong background in optimization techniques and loss function design
Experience with empirical scaling studies and systematic architecture research
Strong proficiency in modern deep learning tooling (PyTorch, CUDA, Triton, FSDP, etc.)
Experience training diffusion models with 10B+ parameters
Deep understanding of attention, transformers, and modern multimodal architectures
Expertise in distributed training systems and model parallelism
Proven ability to implement and improve complex model architectures
Track record of systematic empirical research and rigorous evaluation
Ability to write clean, modular research code that scales
Strong software engineering practices including testing and code review
Experience with rapid prototyping and experimental design
Strong analytical skills for debugging model behavior and training dynamics
Facility with profiling and optimization tools
Track record of bringing research ideas to production
Experience maintaining high code quality in a research environment

Preferred

Experience with very large language models (200B+ parameters)

Benefits

Comprehensive medical, dental, and vision plans
401K with employer match
Commuter Benefits
Catered lunch multiple days per week
Dinner stipend every night if you're working late and want a bite!
Grubhub subscription
Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)
Multiple team offsites per year with team events every month
Generous PTO policy

Company

Mirage

twittertwittertwitter
company-logo
Mirage is building foundation models and products that change the future of video.

Funding

Current Stage
Growth Stage
Total Funding
$100M
Key Investors
Index VenturesKleiner Perkins
2024-07-09Series C· $60M
2023-06-22Series B· $25M
2022-04-08Series A· $11M

Leadership Team

leader-logo
Gaurav Misra
Co-Founder, CEO
linkedin
Company data provided by crunchbase