Engineering Manager, Evaluations & Observability jobs in United States
cer-icon
Apply on Employer Site
company-logo

Retool · 1 month ago

Engineering Manager, Evaluations & Observability

Retool is seeking an Engineering Manager to lead their Evaluations & Observability platform. In this role, you will be responsible for guiding engineers in building systems and frameworks that ensure quality and performance across AI models, while fostering a culture of continuous improvement and collaboration with product teams.

Enterprise SoftwareProductivity ToolsSoftwareSoftware Engineering
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Communicate and collaborate effectively with Product and other Engineering counterparts
Manage a team of engineers; support the team by identifying growth opportunities, providing continuous feedback, and performance management as appropriate
Understand the needs of our Assist roadmap, helping define rubrics & automated systems that allow engineers to iterate quickly on product features, with confidence
Establish and define your team's strategy to ensure execution maximizes business impact
Introduce scalable, repeatable processes that help engineering and product teams deliver a successful product
Partner with recruiting on building out a diverse team of exceptionally motivated engineers

Qualification

AI evaluation systemsTechnical curiosityTeam managementEngineering strategyProcess improvementStakeholder managementEngineering cultureCollaborationCommunication

Required

3+ years of experience successfully leading and managing teams
Familiarity with AI evaluation & observability systems – we use Braintrust, but exposure to general evaluation & LLM observability systems is a plus
Deep technical curiosity. You'll be writing code, engaging deeply on design and architecture, and tinkering to uncover what's really happening under the hood
A strong ability to champion an engineering team through macro process changes
A history of orienting teams and setting strategy toward engineering goals, with a bias toward impact
A propensity to operate as a business-owner—caring deeply about our customers, product, and team
Thoughtfulness around engineering culture, process, and identity
Proficiency in navigating through ambiguity, managing stakeholders, communicating in a structured manner, as well as driving maximal accountability and excellence
A collaborative skillset to partner effectively with product, design, and go-to-market teams

Company

Retool is a software development company that offers solutions in AI apps, documentation, developer tools, and external apps.

H1B Sponsorship

Retool has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (13)
2024 (12)
2023 (5)
2022 (13)
2021 (4)
2020 (1)

Funding

Current Stage
Growth Stage
Total Funding
$141M
Key Investors
Sequoia Capital
2022-07-27Series C· $45M
2021-12-22Series C· $20M
2020-10-20Series B· $50M

Leadership Team

leader-logo
David Hsu
Founder, CEO
linkedin
Company data provided by crunchbase