Apply on Employer Site

Cairns Health · 1 day ago

Lead LLM Engineer, Full Stack

Sunnyvale, CA

Full-time

Hybrid

Senior Level, Lead/Staff

3+ years exp

Cairns Health is creating a fundamentally better healthcare experience for people with chronic health conditions. They are seeking a mission-driven Lead LLM Engineer to manage and innovate their LLM architecture, ensuring a best-in-class experience while collaborating with the prompt engineering team to enhance user engagement and reduce friction for patients.

Consumer ElectronicsElder CareHealth CareHome Health Care

Responsibilities

Manage and maintain LLM infrastructure with appropriate guardrails to ensure we are maximizing access to features that can be delivered consistently and on persona while mitigating hallucinations

Design and implement appropriate architecture to ensure performance including constellations with failover capabilities

Daily coding and and weekly code reviews with CTO

Daily collaboration with prompt engineering team to drive pipeline of new features to staging and production environments

Optimize our LLM applications for latency, concurrency, uptime, and other key metrics

Collaborate with a team of accomplished, high-performing engineers

Qualification

LLM architecturePythonJava 11+RESTful APIsPostgreSQLDockerKubernetesAWS EKSCI/CD pipelinesAgile/ScrumProblem-solvingCommunicationTeam player

Required

Bachelor's degree in Computer Science, Engineering, or a related field or equivalent practical experience, coupled with 3-5 years of professional experience as a Full Stack Software Engineer or in a similar role

3 years professional experience in LLM architectures (e.g. RAG, Constellations, etc…) is a must

Familiarity with commonly used LLM APIs (OpenAI, Gemini, Claude, etc.)

Proficient in Python and Java 11+ for developing robust server-side applications and experienced in designing and implementing RESTful APIs to facilitate seamless integration between front-end and back-end systems

Hands-on experience with PostgreSQL or other relational databases, ensuring efficient data storage, retrieval, and management for scalable applications

Proficient in containerization using Docker and orchestration with Kubernetes, with a proven track record of deploying and managing applications on AWS EKS (Elastic Kubernetes Service) and ECS (Elastic Container Service)

Familiarity with messaging systems like Kafka and MQTT for real-time data processing and communication, along with proficiency in using GitHub for version control and collaborative development

Experience implementing and managing CI/CD pipelines using GitHub Actions or similar tools, familiarity with Agile/Scrum methodologies for iterative and collaborative software development, and strong problem-solving and analytical abilities to tackle complex technical challenges

Positive, team player with strong people skills and excellent communication