Patronus AI · 1 day ago
Research Scientist
San Francisco, CA
Full-time
Onsite
Mid, Senior LevelPatronus AI is focused on providing security and risk management for AI systems. The Research Scientist will be responsible for developing state-of-the-art AI evaluation systems, conducting research on language models, and collaborating with product and engineering teams to advance AI technology.
Artificial Intelligence (AI)Information TechnologyNetwork Security
Responsibilities
Develop state-of-the-art systems for AI evaluation. Implement algorithms and models based on state-of-the-art NLP advancements, especially in the areas of evaluation and LLM alignment
Conduct novel research on redteaming language models, automated evaluation and alignment
Scope out and lead research projects, including experiment design, timelines for research deliverables, understanding results
Develop processes for high quality research, including dataset collection, model training, benchmarking and inference
Experiment with latest technologies and proactively suggest experiments and improvements to research and ML systems. Adapt to changes in generative AI landscape, and incorporate new models into the platform when applicable
Assist in the construction of high quality, novel datasets for classification and generative tasks, through synthetic data augmentation techniques and publicly available datasets
Contribute to research to production efforts that advance product offerings
Collaborate closely with product and engineering in our globally-based team
Qualification
Required
Publications at leading AI conferences, journals or workshops, such as NeurIPS, ICML, EMNLP, ACL, AAAI
Experience conducting empirical NLP research in an academic or industry research lab
Knowledge and understanding of state-of-the-art machine learning concepts, with a focus on NLP. Familiarity with transformer-based architectures, attention mechanisms, evaluation metrics and benchmarks
Experience training language models in applied or research settings
Experience working and communicating cross functionally in a team environment
Creativity in problem solving and strong communication skills
Have good character, integrity and respect for others
Benefits
Competitive salary and equity packages
Health, dental, and vision insurance plans
401(k) plan
Unlimited PTO
Fun global offsites!
Company
Patronus AI
Patronus AI operates as an automated evaluation and security platform.
Founded in 2023
11-50 employees
H1B Sponsorship
Patronus AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageTotal Funding
$20MKey Investors
Notable CapitalLightspeed Venture Partners
2024-05-22Series A· $17M
2023-09-14Seed· $3M
Leadership Team
Rebecca Qian
Co-Founder
Recent News
2025-12-31
2025-12-20
Company data provided by crunchbase