Braintrust · 2 hours ago
AI Engineer
United States
Full-time
Remote
Mid, Senior Level
3+ years expBraintrust is the AI observability platform that connects evals and observability in one workflow. They are seeking an AI Engineer to work with strategic customers, helping them deploy and scale AI applications in production environments while ensuring reliability and value extraction from the platform.
Artificial Intelligence (AI)Data IntegrationData Management
Responsibilities
Partner closely with customer engineering teams to deploy, stabilize, and continuously improve AI applications in production
Instrument and trace real-world AI workflows end-to-end, establishing baseline targets for latency, cost, quality, and reliability
Turn production data into datasets and evaluations; define scoring rubrics and implement CI quality gates
Build prototypes, integrations, and custom workflows that help customers operationalize evaluations and observability as part of their SDLC
Deploy and troubleshoot Braintrust in customer environments (cloud or self-hosted), working across application, data, and infrastructure layers
Act as the technical lead in customer engagements, running an operating cadence and feeding real-world learnings back into Product and Engineering
Qualification
Required
3–7+ years of experience as a software engineer or forward-deployed / field engineer
Strong backend or full-stack engineering skills (Python strongly preferred; TypeScript a plus)
Hands-on experience working with LLMs, APIs, or agentic workflows in production environments
Familiarity with cloud infrastructure and deployment patterns (AWS preferred; Docker/Kubernetes a plus)
Comfortable working directly with customers and owning technical outcomes end-to-end
Strong communication skills and ability to translate between business needs and technical implementation
Bias toward action: you enjoy shipping scrappy but production-ready solutions and iterating quickly
Preferred
Experience with AI observability, evaluation frameworks, or ML/LLMOps tooling
Prior experience in a startup, founding team, or 0→1 product environment
Experience supporting enterprise or self-hosted deployments
Willingness to travel occasionally for on-site customer engagements
Benefits
Medical, dental, and vision insurance
Daily lunch, snacks, and beverages
Flexible time off
Competitive salary and equity
AI Stipend
Company
Braintrust
Braintrust offers an AI stack to simplify the process from evaluations to data management, ensuring seamless integration into any business.
11-50 employees
H1B Sponsorship
Braintrust has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
Funding
Current Stage
Early StageTotal Funding
$41.1MKey Investors
Andreessen HorowitzGreylock
2024-10-08Series A· $36M
2023-12-13Seed· $5.1M
Leadership Team
Ankur Goyal
Founder & CEO
Recent News
Greylock
2025-12-01
Seattle TechFlash
2025-09-16
Company data provided by crunchbase