Abridge · 3 months ago
Software Engineer, Gen AI Platform
San Francisco-Hybrid
Full-time
Hybrid
Mid Level
$162K/yr - $234K/yrAbridge is a company dedicated to enhancing healthcare understanding through AI technology. They are seeking an AI Platform Engineer to design and build systems that utilize generative AI for healthcare, collaborating with a cross-functional team to improve clinical documentation and patient-clinician interactions.
Artificial Intelligence (AI)Health CareIntelligent SystemsMachine LearningMedical
Responsibilities
Design and build GenAI systems that turn LLMs into composable, dependable tools—leveraging retrieval, tool use, agentic reasoning, and structured outputs
Design and implement a highly reliable and scalable agent runtime: orchestration, shared state and memory, tool-calling interfaces, and scheduling for cost, latency, and quality
Build secure, sandboxed execution for agent actions and code; optimize cold start, isolation, and observability
Ship unified interfaces for multiple model sizes and providers; integrate with open tool ecosystems such as MCP-style connectors for data and actions
Develop an evaluation platform for online and offline assessments, A/B tests, safety checks, and regression gates that improve agent reliability over time
Partner with Research to deliver new agent capabilities end to end—from prototype to production
Qualification
Required
Experience building agent applications with tool-calling, context engineering, or open connector integrations
Fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex, or custom pipelines)
Experience with retrieval systems (e.g., semantic and lexical retrieval, vector DBs, efficient kNN), function calling, tool use, or agentic workflows
Strong coding skills in one or more of: Python, Java, Go. Comfortable with service design, APIs, and data models for high-throughput systems
Working knowledge of containers and kubernetes concepts. Familiarity with metrics, tracing, on-call rotations, and incident response practices
Self-motivated with a willingness to take ownership
Strong communication skills and ability to work collaboratively in a team environment
Preferred
Prior work on agent orchestration pipelines: task routing, planning, memory graphs, vector search, or browser automation
Experience with evaluations, preference optimization, or RL to improve LLM reliability
Benefits
Generous Time Off: 13 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees.
Comprehensive Health Plans: Medical, Dental, and Vision plans for all full-time employees. Abridge covers 100% of the premium for you and 75% for dependents. If you choose a HSA-eligible plan, Abridge also makes monthly contributions to your HSA.
Paid Parental Leave: 16 weeks paid parental leave for all full-time employees.
401k and Matching: Contribution matching to help invest in your future.
Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.
Learning and Development Budget: Yearly contributions for coaching, courses, workshops, conferences, and more.
Sabbatical Leave: 30 days of paid Sabbatical Leave after 5 years of employment.
Compensation and Equity: Competitive compensation and equity grants for full time employees.
Company
Abridge
Abridge is an AI-driven platform that transforms patient-clinician conversations into structured clinical notes for healthcare industries.
Founded in 2018
201-500 employees
H1B Sponsorship
Abridge has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (1)
2022 (1)
Funding
Current Stage
Late StageTotal Funding
$757.5MKey Investors
Spark CapitalIKS HealthWittington Ventures
2025-06-24Series E· $300M
2025-02-17Series D· $250M
2024-02-23Series C· $150M
Leadership Team
Jonathan Lydon
VP People
Recent News
MedCity News
2026-01-07
HospitalManagement.net
2025-12-24
Company data provided by crunchbase