AI Orchestration Engineer jobs in United States
info-icon
This job has closed.
company-logo

Sage Care · 2 months ago

AI Orchestration Engineer

positionPalo Alto, CA
timeFull-time
remoteHybrid
seniorityMid Level

Sage Care is a fast-growing Series A healthcare technology startup focused on transforming healthcare through AI-driven solutions. The AI Orchestration Engineer will design, implement, and maintain systems that coordinate multiple AI models and workflows, ensuring they interact effectively and integrate seamlessly into real-world applications.

Artificial Intelligence (AI)Health CareHospitalMedical
check
H1B Sponsor Likelynote

Responsibilities

Build and manage directed workflows (DAGs, state machines, LangGraph flows)
Define how data and context move between AI models, APIs, and humans in the loop
Design coordination strategies for multiple AI agents with specialized roles
Implement arbitration logic to merge outputs, resolve conflicts, and dynamically route tasks
Connect AI systems with vector databases, APIs, cloud platforms, and external data sources
Handle orchestration across distributed environments (Kubernetes, serverless)
Implement retries, fallbacks, and guardrails to keep workflows stable
Ensure systems degrade gracefully when AI outputs are uncertain or incorrect
Tune orchestration for cost, latency, and accuracy
Build observability dashboards, logging, and metrics to measure workflow success
Routing patient triage queries across different AI agents (diagnosis, risk scoring, recommendations)
Coordinating a retrieval-augmented generation (RAG) pipeline: retriever → ranker → LLM
Running human-in-the-loop workflows where AI suggests and humans validate
Ensuring continuity across multi-step processes, such as decision trees for medical protocols

Qualification

PythonKubernetesDockerLangGraphTypeScriptGoCI/CD pipelinesObservability toolsVector databasesAI/ML UnderstandingReliability engineeringDistributed systemsHuman-in-the-loop AI

Required

Proficiency in Python, TypeScript, or Go (depending on orchestration stack)
Experience with LangGraph, LangChain, or Ray
Strong knowledge of Docker, Kubernetes, CI/CD pipelines, and observability tools (Prometheus, Grafana)
Familiarity with LLMs, RAG systems, embeddings, and multi-agent patterns
Experience with vector databases (FAISS, Pinecone, Weaviate) and caching systems (Redis, Memcache)

Preferred

Hands-on experience with healthcare workflows or regulated environments
Exposure to human-in-the-loop AI systems
Background in reliability engineering or distributed systems

Company

Sage Care

twittertwitter
company-logo
Sage Care uses AI to automate patient triage, optimize doctor-patient matching, and improve appointment efficiency.
location
Palo Alto, California, USA
people-size2-10 employees
web-link
https://www.sage.care/

H1B Sponsorship

Sage Care has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)

Funding

Current Stage
Early Stage
Total Funding
$20M
Key Investors
Yosemite
2025-10-17Series Unknown· $20M
2024-04-08Seed

Recent News

Pulse 2.0
Sage Care: $20 Million Raised For AI-Based Care Navigation System
2025-10-27
thesaasnews.com
Sage Care Raises $20 Million in Funding
2025-10-20
Pulse 2.0
Sage Care: $20 Million Closed To Transform Healthcare Navigation Using AI
2025-10-20
Company data provided by crunchbase