Anthropic · 4 days ago
Software Engineer, Safeguards
New York, NY
Full-time
Hybrid
Senior Level
$320K/yr - $425K/yr
5+ years expAnthropic is a public benefit corporation focused on creating reliable and interpretable AI systems. They are seeking a software engineer for the Safeguards team to develop monitoring systems, build abuse detection mechanisms, and ensure user well-being in AI usage.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
Build abuse detection mechanisms and infrastructure
Surface abuse patterns to our research teams to harden models at the training stage
Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
Analyze user reports of inappropriate content or accounts
Qualification
Required
Bachelor's degree in Computer Science, Software Engineering or comparable experience
5-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection and mitigation
Proficiency in Python and Typescript
Ability to work across the stack
Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Preferred
Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
Have worked closely with operational teams to build custom internal tooling
Benefits
Equity
Benefits
Incentive compensation
Generous vacation and parental leave
Flexible working hours
Company
Anthropic
Anthropic is an AI research company that focuses on the safety and alignment of AI systems with human values.
501-1000 employees
H1B Sponsorship
Anthropic has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (105)
2024 (13)
2023 (3)
2022 (4)
2021 (1)
Funding
Current Stage
Late StageTotal Funding
$33.74BKey Investors
Lightspeed Venture PartnersGoogleAmazon
2025-09-02Series F· $13B
2025-05-16Debt Financing· $2.5B
2025-03-03Series E· $3.5B
Leadership Team
Dario Amodei
CEO & Co-Founder
Daniela Amodei
President and co-founder
Recent News
Qualcomm Ventures
2026-01-10
2026-01-09
Company data provided by crunchbase