Arbiter · 6 hours ago
Senior Backend AI Engineer
New York, NY
Full-time
Hybrid
Senior Level
$180K/yr - $240K/yr
5+ years expArbiter is an AI-powered care orchestration system that optimizes patient outcomes through innovative technology. They are seeking a Senior Backend AI Engineer to design, build, and operate backend AI systems for their Agentic platform, ensuring high performance and reliability in healthcare workflows.
Artificial Intelligence (AI)Health CareMedical
Responsibilities
Build the Agentic Platform: Design, develop, and operate the backend systems that power Arbiter’s agent-driven care orchestration workflows, including service orchestration, inference pipelines, and automation primitives
Production AI Systems: Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows, with real customer dependency and strict reliability, latency, and correctness requirements
Platform Architecture & Scalability: Contribute to the architectural design of Arbiter’s AI-driven platform, emphasizing modularity, extensibility, scalability, and clean integration with EMRs, data systems, and external services
Inference & Backend Reliability: Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines through strong system design, monitoring, and operational best practices
Infrastructure & Deployment Excellence: Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems in production environments
Cross-Functional Execution: Partner closely with data scientists, product managers, clinical experts, and other engineers to translate ambiguous, high-impact problems into scalable technical solutions
Technical Leadership & Mentorship: Mentor engineers, contribute to internal documentation and standards, influence technical direction, and raise the overall engineering bar
Ownership & On-Call: Take end-to-end ownership of critical systems, including participating in on-call rotations and leading incident resolution when production issues arise
Qualification
Required
5 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments
Computer Science or Engineering degree, or equivalent practical experience
Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs
Proven experience designing and operating complex backend systems in production
Deep understanding of concurrency, scalability, reliability, and distributed systems patterns
Hands-on experience with async or event-driven architectures
Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility
Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments
Experience building and shipping AI-powered systems beyond prototypes or internal demos
Strong communication skills and ability to work effectively across functions
Preferred
Experience building agentic workflows, including single- or multi-agent systems, orchestration across tools and services, and human-in-the-loop patterns
Experience integrating LLM APIs and understanding prompt engineering and evaluation methodologies
Proficiency with AI-assisted development tools (e.g., Cursor, Claude Code, GitHub Copilot)
Track record of delivering complex systems end-to-end with minimal oversight
Startup or early-stage experience operating in fast-moving, high-ambiguity environments
Benefits
Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.
Generous Paid Time Off (PTO): To ensure a healthy work-life balance.
Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.
Life and Disability Insurance: Providing financial security.
Simple IRA Matching: To support your long-term financial goals.
Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.
Wellness Programs: Initiatives to support your physical and mental health.
Company
Arbiter
Arbiter AI-powered system unites healthcare by connecting patients, providers, and payers on one intelligent care orchestration platform.
11-50 employees
Funding
Current Stage
Early StageTotal Funding
$52M2025-11-19Seed· $52M
Recent News
Venture Capital Firms
2025-11-21
Company data provided by crunchbase