OpenAI · 6 hours ago
Software Engineer, Applied Evals
San Francisco, CA
Full-time
Hybrid
Mid, Senior Level
$255K/yr - $325K/yr
4+ years expOpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The role involves designing and building evals and harnesses that capture real-world quality for advanced AI systems, focusing on model improvement and collaboration with research and product teams.
Agentic AIArtificial Intelligence (AI)Foundational AIGenerative AIMachine LearningNatural Language ProcessingSaaS
Responsibilities
Define the core evaluation signals that drive model improvement at OpenAI, turning vague product gaps into crisp, defensible measures of quality
Design agents, harnesses, and eval pipelines that are reliable, reproducible, and extendable
Prototype solutions with real workflows and convert them into scalable feedback loops
Connect evaluation signals directly to research and training systems so product improvements show up in what users experience
Shape model interaction paradigms by partnering with engineering, research, and product teams on how models are deployed and measured
Build reusable systems and tools that enable contributions from across the company and steadily raise the quality bar
Qualification
Required
4+ years of experience in software engineering with strong fundamentals and a track record of shipping production systems end-to-end
Experience building AI agents or applications, including designing evals and improving performance through prompting or scaffolding
Familiarity with evaluation methods for LLMs and have worked with patterns like multi-agent workflows, tool use, or long context
Familiarity with deep learning concepts or have prior exposure to training models
Ability to communicate clearly across technical and non-technical audiences across levels
Motivated by high-impact collaboration with research and product teams and thrive in ambiguity
Benefits
Relocation assistance
Company
OpenAI
OpenAI is an AI research and deployment company that develops advanced AI models, including ChatGPT. It is a sub-organization of OpenAI Foundation.
201-500 employees
H1B Sponsorship
OpenAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)
2023 (1)
2022 (18)
2021 (10)
2020 (6)
Funding
Current Stage
Growth StageTotal Funding
$79BKey Investors
The Walt Disney CompanySoftBankThrive Capital
2025-12-11Corporate Round· $1B
2025-10-02Secondary Market· $6.6B
2025-03-31Series Unknown· $40B
Leadership Team
Sam Altman
CEO & Co-Founder
Greg Brockman
President, Chairman, & Co-Founder
Recent News
The Express Tribune
2026-01-16
Company data provided by crunchbase