Ellipsis Health · 16 hours ago
Senior Backend Engineer (Python)
United States
Full-time
Remote
Mid, Senior Level
$180K/yr - $260K/yr
4+ years expEllipsis Health is developing cutting-edge AI/ML products to address healthcare staffing issues and administrative burdens. The Senior Backend Engineer will be responsible for expanding and maintaining the real-time voice pipeline and collaborating with cross-functional teams to deliver innovative features.
Artificial Intelligence (AI)Health CareInformation TechnologySoftware
Responsibilities
Expand and maintain our real-time voice pipeline: design, implement, and maintain Python micro-services for conversational AI orchestration—audio capture, streaming transcription, prompt/LLM logic, synthesis, and playback
Integrate new providers & transports: add plug-ins for emerging ASR, TTS, LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build adapters that allow hot-swapping components without downtime. Build API endpoints
Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio, FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling
Instrument & observe every hop: emit structured traces (OpenTelemetry), metrics, and logs for each pipeline stage; define SLOs for first-token latency, end-to-end latency, and streaming reliability
Harden for production: implement graceful retries, idempotent message passing, circuit breakers, and HIPAA-compliant security (encryption in transit, per-tenant isolation, secrets rotation)
Collaborate cross-functionally with ML, product, data engineering, and client-SDK teams to deliver features such as voice cloning, multimodal hand-offs, and domain-specific memory retrieval
Qualification
Required
4+ years building production back-ends in modern Python
Proven experience with real-time streaming systems—WebRTC, WebSockets, or gRPC streaming—and proficiency with asyncio, FastAPI, or similar async frameworks
Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and distributed tracing
Solid understanding of AWS/GCP/Azure, including container orchestration (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC (Terraform)
Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores; able to model and persist conversational state
Excellent communication skills and a bias for measured, observable, and continuously deployable software
Preferred
B.S./M.S. in CS, EE, or related fields
Familiarity with voice-agent frameworks
Hands-on with telephony (Twilio, Telnyx), SIP, or PSTN integrations
Experience integrating multimodal inputs (vision, text chat) into voice agents
Familiarity with GPU inference and streaming pipelines
Prior work in regulated industries (healthcare, finance) and comfort preparing for SOC 2 / HIPAA audits
Benefits
401 (k) matching up to a specified percentage of your salary
Health, vision, and dental insurance
Flexible paid time off
Company
Ellipsis Health
AI Nursing Care Manager
11-50 employees
H1B Sponsorship
Ellipsis Health has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (1)
2023 (2)
2021 (1)
Funding
Current Stage
Early StageTotal Funding
$75.02MKey Investors
CVS Health Ventures,Khosla Ventures,SalesforceSJF VenturesKhosla Ventures
2025-06-12Series A· $45M
2021-06-15Series A· $26M
2021-01-13Seed
Leadership Team
Mainul Mondal
Founder & CEO
Dr. Michael Aratow
Chief Medical Officer, Co-Founder
Recent News
2025-10-22
Company data provided by crunchbase