Hippocratic AI · 2 months ago
Head of Data Operations
Palo Alto
Full-time
Onsite
Director/Executive
10+ years expHippocratic AI is developing a safety-focused Large Language Model for healthcare to improve accessibility and health outcomes. The Head of Data Operations will lead the data operations team, managing data generation, annotation, and evaluation to ensure high-quality data pipelines that align with safety and ethics principles.
Artificial Intelligence (AI)Foundational AIGenerative AIHealth CareInformation Technology
Responsibilities
Build, lead, and scale a global data operations organization including full-time employees, contractors, and vendor partners
Define clear roles, quality standards, and performance metrics across all data functions (evaluation, labeling, RLHF, and generation)
Partner with Legal, Compliance, and Security to ensure all global data work adheres to HIPAA and data privacy standards
Oversee the design and execution of evaluation frameworks for LLMs and agentic behaviors — both automated and human-in-the-loop
Lead data labeling, synthesis, and annotation operations, ensuring medical accuracy, consistency, and context-rich quality
Manage large-scale RLHF pipelines — aligning training data with clinical and ethical objectives
Optimize throughput, cost, and quality across in-house teams and external vendors
Partner with engineering and product to design and improve data operations infrastructure, including labeling tools, quality assurance systems, and task routing platforms
Implement robust QA processes and auditing frameworks to ensure data integrity and reliability
Drive continuous improvement in efficiency, consistency, and evaluator experience
Work closely with Research, Model, and Product teams to define data needs and feedback loops
Collaborate with Clinical and Safety leaders to align annotation and evaluation standards with clinical guidelines
Provide strategic input into data strategy, metrics, and operational planning
Qualification
Required
10+ years of experience in data operations, annotation, or model evaluation, with 5+ years in management or leadership roles
Proven success scaling data or RLHF operations across geographies and vendors
Strong program management and process optimization skills; experience managing distributed teams
Familiarity with LLM training and evaluation, RLHF, or human-in-the-loop systems
Deep respect for data ethics, privacy, and quality — ideally within healthcare, life sciences, or another regulated industry
Excellent communication and collaboration skills; able to navigate between technical, clinical, and operational stakeholders
Preferred
Experience in medical or healthcare data annotation or clinical workflow modeling
Prior work building custom data pipelines or labeling platforms
Understanding of LLM fine-tuning, preference modeling, and evaluation metrics
Global vendor management experience with large-scale workforce operations
Company
Hippocratic AI
Hippocratic AI is a healthcare technology company that develops safety-focused large-language models for medical applications.
51-200 employees
H1B Sponsorship
Hippocratic AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (1)
Funding
Current Stage
Growth StageTotal Funding
$402MKey Investors
AvenirKleiner PerkinsNVentures
2025-11-03Series C· $126M
2025-01-09Series B· $141M
2024-09-19Series A· $17M
Leadership Team
Alex Miller
Co-Founder
Amy McCarthy
Chief Nursing Officer
Recent News
2026-01-11
Company data provided by crunchbase