Zyphra · 2 months ago
Research Scientist, Model Architectures
Palo Alto, CA
Full-time
Onsite
Senior LevelZyphra is an artificial intelligence company based in Palo Alto, California. The Research Scientist, Model Architectures will contribute to the AI Architecture Research Team by designing and testing novel model architectures and training methodologies to enhance modeling capabilities and address fundamental bottlenecks in contemporary models.
Artificial Intelligence (AI)Cloud ComputingMachine LearningSoftware
Responsibilities
Designing and rigorously testing novel model architectures and training methodologies
Improving core modeling capabilities (in terms of loss per flop or loss per parameter)
Solving fundamental bottlenecks in contemporary models
Working closely with the pretraining team to integrate insights into next-generation models
Qualification
Required
Strong research taste and intuition
The ability to work through a research project from conception to execution to write-up
Strong implementation and prototyping ability can take an idea from conception to experimentation extremely quickly
The ability to work well and cooperate with others in a high-paced research setting
Curiosity, interest, and joy in understanding intelligence
Previous experience with long-term memory, RAG/retrieval systems, dynamic/adaptive computation, and alternative approaches to credit assignment
Experience with reinforcement learning, control theory, and signal processing
Generally, a joy in inventing and seriously assessing ‘crazy' ideas, and the ability to have a unique perspective on things
Understanding of modern training pipelines and the hardware requirements to design efficient architectures for GPU hardware
Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing
High proficiency with PyTorch and Python
Strong ability to jump into large pre-existing codebases and rapidly get up to speed and become productive
Previously published machine learning research in well-respected venues
Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Math, Physics)
Benefits
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k)
Relocation and immigration support on a case-by-case basis
On-site meals prepared by a dedicated culinary team; Thursday Happy Hours
In-person team in Palo Alto, CA, with a collaborative, high-energy environment
Company
Zyphra
Zyphra is superintelligence research and product company based in San Francisco, California.
Founded in 2021
51-200 employees
H1B Sponsorship
Zyphra has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Growth StageTotal Funding
$100M2025-06-09Series A· $100M
2023-06-09Seed
2021-11-18Pre Seed
Recent News
2025-11-30
2025-11-27
Company data provided by crunchbase