Apply on Employer Site

Aegis Ventures · 1 month ago

Senior / Staff AI Software Engineer

United States

Full-time

Remote

Senior Level, Lead/Staff

$185K/yr - $280K/yr

7+ years exp

Aegis Ventures partners with entrepreneurs and industry leaders to launch transformative companies in digital health and artificial intelligence. As a Senior or Staff AI Software Engineer at Caregentic, you will have end-to-end ownership of key parts of our backend services architecture and AI-driven applications, focusing on building scalable systems that impact patient care and mentoring other engineers.

Artificial Intelligence (AI)Health Care

Responsibilities

Design and develop robust, scalable, event-driven services using Python, FastAPI, Apache Kafka and GraphQL

Build fundamental LLM agents and integrate them into our product

Work with DevOps on deployments, monitoring, and reliability improvements

Maintain and optimize PostgreSQL databases and data models

Collaborate across product and engineering teams to define requirements and architect features

Drive engineering best practices through code reviews and mentorship

Engage with current and prospective clients to drive understanding of the Caregentic AI architecture and capabilities

Design, build, and operate LLM services, including RAG systems (LangChain), agentic workflows, and evaluation pipelines (LangSmith, deepeval, A/B testing)

Own vector search & embeddings pipelines from schema and metadata design to model benchmarking, cost/latency optimization, and Databricks Vector Search integration

Lead conversational AI development enhancing NLU policies, safety guardrails, and custom action servers, plus integrating assistants with microservices

Qualification

Python 3.12FastAPIPostgreSQLAI systemsGraphQL APIsDockerKubernetesAWSEvent-driven systemsMicroservice architecturesTesting practicesTechnical leadershipCommunication

Required

7+ years of backend development experience in production environments, specifically strong Python skills, including async programming and type hints

Experience building and monitoring production-quality ML and AI systems

Hands-on expertise with RAG frameworks and agentic workflows

Solid understanding of PostgreSQL database design and optimization

Familiarity with Docker and containerization

Strong testing practices using pytest

Experience with event-driven systems and message queues

Experience with major cloud providers (e.g., AWS)

Preferred

Experience with microservice architectures is preferred

Experience with GraphQL APIs

Shipped production LLM systems: ideally RAG architectures, agent/tool use, and prompt/system design, with LangChain (tracing/evals via LangSmith), embeddings, and vector databases (Databricks Vector Search preferred). Deep expertise in retrieval quality, including chunking, metadata, hybrid search, reranking, and grounding

Experience with Strawberry GraphQL

Experience with Kafka, Procrastinate, or similar background job systems

Experience Apollo Federation or multi-service GraphQL experience

Healthcare or regulated industry experience (HIPAA, HL7, FHIR)

Experience with Terraform or infrastructure-as-code

Experience with Kubernetes

Experience mentoring engineers or leading technical projects

Experience working with LangSmith tracing, AWS Bedrock, LangChain runnables

Experience maintaining forked open source repositories

Experience with managing conversation states in conversational agents - experience with LangGraph or similar