Prompt Engineer, Agent Prompts & Evals jobs in United States
cer-icon
Apply on Employer Site
company-logo

Anthropic · 2 hours ago

Prompt Engineer, Agent Prompts & Evals

Anthropic is a public benefit corporation focused on creating reliable and beneficial AI systems. They are seeking a Prompt Engineer to join their product engineering team, responsible for bridging model capabilities with user experience, and ensuring the quality and safety of AI products through effective prompt engineering and evaluation development.

Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
check
H1B Sponsorednote

Responsibilities

Prompt Engineering Excellence: Design, test, and optimize system prompts and feature-specific prompts that shape Claude’s behavior across consumer and API products
Evaluation Development: Build and maintain comprehensive evaluation suites that ensure model quality and consistency across product launches and updates
Cross-functional Collaboration: Partner closely with product teams, research teams, and safeguards to ensure new features meet quality and safety standards
Model Launch Support: Play a critical role in model releases, ensuring smooth rollouts and catching regressions before they impact users
Infrastructure Contribution: Help build and improve the frameworks and tools that allow teams to develop and test prompts and features with confidence
Knowledge Transfer: Mentor product engineers on prompt engineering best practices and help teams build their first evaluations
Rapid Iteration: Work in a fast-paced environment where model capabilities advance daily, requiring quick adaptation and creative problem-solving

Qualification

PythonLLMsPrompt engineeringEvaluation methodologiesVersion controlCI/CDMachine learningNLPA/B testingAI safetyCommunication skillsProject management

Required

5+ years of software engineering experience with Python or similar languages
Demonstrated experience with LLMs and prompt engineering (through work, research, or significant personal projects)
Strong understanding of evaluation methodologies and metrics for AI systems
Excellent written and verbal communication skills – you'll need to explain complex model behaviors to diverse stakeholders
Ability to manage multiple concurrent projects and prioritize effectively
Experience with version control, CI/CD, and modern software development practices
At least a Bachelor's degree in a related field or equivalent experience

Preferred

Experience with Claude or other frontier AI models in production settings
Background in machine learning, NLP, or related fields
Experience with A/B testing and experimentation frameworks (e.g., Statsig)
Familiarity with AI safety and alignment considerations
Experience building tools and infrastructure for ML/AI workflows
Track record of improving AI system performance through systematic evaluation and iteration

Benefits

Optional equity donation matching
Generous vacation and parental leave
Flexible working hours

Company

Anthropic

twittertwittertwitter
company-logo
Anthropic is an AI research company that focuses on the safety and alignment of AI systems with human values.

H1B Sponsorship

Anthropic has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (105)
2024 (13)
2023 (3)
2022 (4)
2021 (1)

Funding

Current Stage
Late Stage
Total Funding
$33.74B
Key Investors
Lightspeed Venture PartnersGoogleAmazon
2025-09-02Series F· $13B
2025-05-16Debt Financing· $2.5B
2025-03-03Series E· $3.5B

Leadership Team

leader-logo
Dario Amodei
Co-Founder and CEO
linkedin
leader-logo
Daniela Amodei
President and co-founder
linkedin
Company data provided by crunchbase