Hippocratic AI · 10 hours ago
Staff Software Engineer
Palo Alto, CA
Full-time
Onsite
Senior Level, Lead/Staff
7+ years expHippocratic AI is the leading generative AI company in healthcare, focused on creating a safety-first AI platform for clinical conversations with patients. The Staff Software Engineer will collaborate with engineers and healthcare professionals to enhance generative AI technologies, specifically by building and optimizing core systems for model inference at scale.
Artificial Intelligence (AI)Foundational AIGenerative AIHealth CareInformation Technology
Responsibilities
Build control plane components around scheduling and capacity planning of cross-cloud distributed inference platform
Architect, develop, and maintain scalable backend infrastructure to support high-performance healthcare AI applications
Contribute to platform capabilities such as latency-aware routing, model versioning, health monitoring, and observability
Improve performance, autoscaling, GPU utilization, and resource efficiency in a cloud-native environment. Work across product, and ML teams to ensure the inference platform meets the scale, reliability, and latency demands of our use cases
Hands-on experience with tools like llm-d, SGLang and container orchestration with Kubernetes
Mentor junior engineers, providing guidance on technical projects and fostering a culture of collaboration and innovation
Qualification
Required
Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
7+ years of experience in backend development with proficiency in languages like Python, Java, or Go
Strong understanding of SaaS, and cloud orchestration software. (Control Plane)
In-depth knowledge of one or more of cloud platforms (AWS, GCP, or Azure) including Docker, Kubernetes, and cloud networking
Familiar with concepts in ML model serving and inference runtimes
Excellent communication skills and experience working collaboratively within cross-functional teams
Preferred
Experience integrating infrastructure with production ML workloads
Experience in model serving, inference, observability, and distributed infrastructure
Previous experience in healthcare-related technologies or regulated data environments
Company
Hippocratic AI
Hippocratic AI is a healthcare technology company that develops safety-focused large-language models for medical applications.
51-200 employees
H1B Sponsorship
Hippocratic AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (1)
Funding
Current Stage
Growth StageTotal Funding
$402MKey Investors
AvenirKleiner PerkinsNVentures
2025-11-03Series C· $126M
2025-01-09Series B· $141M
2024-09-19Series A· $17M
Leadership Team
Alex Miller
Co-Founder
Amy McCarthy
Chief Nursing Officer
Recent News
2026-01-11
Company data provided by crunchbase