Center for AI Safety · 12 hours ago
Research Scientist
San Francisco, CA
Full-time
Onsite
Senior Level
$140K/yr - $180K/yr
5+ years expThe Center for AI Safety is a research and field-building nonprofit located in San Francisco. As a research scientist, you will pursue various research projects aimed at making AI systems safer and more aligned, collaborating with both internal staff and academics while contributing to publications in top conferences.
Artificial Intelligence (AI)EducationNon Profit
Responsibilities
Pursue a variety of research projects in fields such as Power Aversion, Trojans, Machine Ethics, and Reward Hacking
Set the research directions and strategies to make our AI systems safer, more aligned and more robust
Assist in writing and submitting articles for publication at top conferences
Collaborate with both internal research staff (e.g., Dan Hendrycks) as well as academics at top universities (including Stanford, UC Berkeley, CMU, or MIT)
Leverage our compute cluster to run experiments at scale on large language models
Finetuning large-scale transformers and evaluating them under different data domains
Creating and designing new datasets to evaluate the robustness of different models
Scaling machine learning systems to thousands of GPUs
Evaluating models in sequential decision-making games
Developing and launching ML competitions (e.g., Trojan Detection Challenge)
Collaborating with academics on research ranging from transparency, proxy gaming, honest AI, interpretable uncertainty, and so on
Qualification
Required
Ph.D. in computer science, machine learning, or a related field, with 5+ years of related research experience
Familiar with relevant frameworks and libraries (e.g., pytorch and huggingface)
Have experience launching and training distributed ML jobs
Communicate clearly and promptly with teammates
Have co-authored an NLP or RL paper in a top conference
Benefits
Health insurance for you and your dependents
401(k) plan with 4% matching
Unlimited PTO
Free lunch and dinner at the office
Commuter Benefit program
Annual learning & development stipend
Company
Center for AI Safety
Center for AI Safety is a nonprofit organization that provides AI safety research and education services.
11-50 employees
H1B Sponsorship
Center for AI Safety has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
Funding
Current Stage
Early StageCompany data provided by crunchbase