Recruiting from Scratch · 2 months ago
Staff Software Engineer, Machine Learning
Onsite| Burlingame, CA
Full-time
Onsite
Senior Level, Lead/Staff
$145K/yr - $250K/yr
5+ years expRecruiting from Scratch is a specialized talent firm dedicated to helping companies build exceptional teams. They are seeking a Staff Software Engineer specializing in Machine Learning to architect, build, and scale backend systems that power production LLM applications in healthcare.
Staffing Agency
Responsibilities
Architect scalable APIs and backend services that wrap, orchestrate, and optimize LLM workflows for healthcare applications
Design and implement retrieval-augmented generation (RAG) pipelines and data ingestion systems to ground models in structured healthcare data
Develop observability and reliability frameworks — including monitoring, cost optimization, and safety guardrails for deployed LLMs
Optimize infrastructure performance through caching, batching, and distributed scaling across cloud and containerized environments
Ensure compliance and security by implementing HIPAA-ready infrastructure and robust data governance
Collaborate cross-functionally with ML engineers, product leaders, and healthcare domain experts to deliver reliable AI systems to production
Mentor peers and influence technical direction, establishing engineering best practices for high-scale AI applications
Qualification
Required
5+ years of backend or full-stack software engineering experience
3+ years of hands-on experience building or scaling ML/LLM-enabled systems
Strong programming skills in Python, plus experience with one statically typed language (Go, Java, or TypeScript)
Deep understanding of distributed systems, API design, and microservice architecture
Experience with LLM frameworks such as LangChain, Hugging Face, LlamaIndex, or OpenAI/Anthropic APIs
Cloud-native expertise with AWS, GCP, or Azure, and infrastructure tools like Kubernetes, Docker, and Terraform
Familiarity with MLOps or LLMOps — CI/CD for models, evaluation harnesses, and observability
Strong system design skills and an ability to align technical architecture with product and business goals
Preferred
Experience deploying AI systems in healthcare or other regulated environments (HIPAA, FHIR, HL7)
Hands-on experience with vector databases, RAG pipelines, or structured-output orchestration
Prior work on mission-critical, high-availability SaaS platforms
Knowledge of responsible AI practices, including model safety and data privacy
Benefits
Comprehensive health, dental, and vision coverage
Flexible PTO
Opportunities for professional growth and leadership
Company
Recruiting from Scratch
A recruiting agency working with technology companies to help them hire software engineers, data roles, product managers, and hardware.
11-50 employees
Funding
Current Stage
Early StageLeadership Team
Will Sanders
Founder / CEO
Tom Callahan
Managing Partner, Retained Executive Search
Recent News
Company data provided by crunchbase