Onward Search ยท 4 days ago
AI Safety Engineer - New York City [80881]
Onward Search is seeking a new team member to support a leading industry company's innovative efforts in AI safety and model alignment. The AI Safety Engineer will pressure-test AI systems and help design them to ensure users receive safe recommendations, contributing to critical safety initiatives within a dynamic environment.
AdvertisingHuman ResourcesRecruitingStaffing Agency
Responsibilities
Collaborate with multidisciplinary teams to conduct adversarial testing and red-teaming campaigns, identifying vulnerabilities and generating training data
Develop and oversee processes such as prompt engineering, preference tuning, and automatic prompt optimization to enhance system robustness
Work intensively with data querying, automation frameworks, and model evaluation tools to ensure safety standards are met
Align AI systems with evolving safety policies through scalable, robust work, including high-quality data production and system fine-tuning
Participate in benchmark assessments, comparing system performance with comparable services to identify areas for improvement
Study how model behavior changes with different prompts, context windows, and system instructions
Research preference tuning strategies (e.g., reward models, human feedback, synthetic feedback)
Experiment with automatic prompt optimization to improve safety at scale
Evaluate tradeoffs between safety, usefulness, and personalization quality
Qualification
Required
Demonstrated experience in safety-related research, adversarial testing, or system alignment projects
Proficiency in Python, Java, and SQL, with practical experience working hands-on with complex systems and data
Extensive knowledge of large language models, prompt engineering, and safety techniques
Expertise in safety research, red teaming, and advanced model alignment methods
Preferred
Pursuing or holding an MSc or PhD in an AI/ML-related field, with a focus on safety or agentic systems preferred
Experience with cross-language models is an advantage
Benefits
Medical, dental, and vision insurance
Life insurance coverage
401(k) retirement program
Commuter benefits
ELearning and ongoing training opportunities
Education reimbursement
Company
Onward Search
Recruitment and Staffing Services for Digital, Creative, and Marketing Professionals.
Funding
Current Stage
Growth StageRecent News
Company data provided by crunchbase