Simbie AI · 4 months ago
AI Prompt & Product Engineer
New York, NY
Full-time
Onsite
Entry Level
$60K/yr - $120K/yr
2+ years expSimbie AI is an early-stage healthcare AI startup looking for an AI Prompt & Product Engineer. In this role, you will design, test, and optimize prompts and workflows for real-world healthcare applications, while also contributing to model fine-tuning and evaluation to ensure compliance and usability standards are met.
Health CarePersonal DevelopmentPersonal Health
Responsibilities
Craft and refine prompts that support healthcare tasks like scheduling, eligibility checks, patient education, and intake
Contribute to fine-tuning by preparing datasets, running training jobs, and evaluating results
Explore new model behaviors and compare approaches across LLMs
Build internal tools and scripts to test and benchmark prompts at scale
Translate broad client requests into focused, testable solutions
Work with clinicians and staff to uncover bottlenecks and identify the core workflows worth automating
Break down complex problems into phased rollouts that let us learn quickly while reducing risk
Prototype new use cases and validate them with real users
Be the first user and toughest critic of our AI platform
Design testing scenarios that catch edge cases and failure modes early
Define metrics to measure conversation quality, accuracy, and user trust
Stress-test new features, models, and integrations before release
Contribute directly to product code with Python/JavaScript for automation, integrations, and evaluation pipelines
Partner with engineers on architecture and deployment decisions
Identify opportunities to apply emerging AI techniques (RAG, multi-agent orchestration, lightweight fine-tuning)
Explain technical trade-offs clearly to both internal and external stakeholders
Design, refine, and test prompts to enable accurate and reliable outputs for healthcare scheduling, insurance workflows, patient intake, and education
Build and maintain reusable prompt libraries and evaluation frameworks to improve performance and reproducibility
Contribute to fine-tuning models (collecting and curating datasets, running training jobs, evaluating outputs) to improve domain-specific accuracy
Write code to automate testing, integrate AI workflows into APIs and applications, and monitor performance in production
Collaborate directly with clinicians and operations teams to understand real-world pain points and rapidly prototype solutions
Establish quality guardrails to ensure safety, compliance, and trust in patient-facing outputs
Contribute to broader product development beyond prompts—helping with data pipelines, integrations, and deployment
Qualification
Required
Bachelor's degree in Computer Science, Data Science, or related field (or equivalent startup experience)
Proficiency in Python and/or JavaScript/TypeScript for scripting, automation, and API integration
Hands-on experience with large language models (OpenAI, Anthropic, etc.) and prompt design
Familiarity with fine-tuning workflows (data preprocessing, evaluation metrics, supervised/LoRA training, or similar)
Strong problem-solving skills and creativity in working with language and workflows
Excellent communication skills to translate between technical, clinical, and operational needs
Comfort operating in a fast-paced startup environment with limited structure
Preferred
Experience with healthcare data standards and workflows (EHR, HL7/FHIR, insurance claims)
Knowledge of cloud platforms (AWS, GCP, Azure) and deployment best practices
Familiarity with compliance frameworks (HIPAA, SOC 2)
Experience working cross-functionally in small teams where responsibilities overlap
Company
Simbie AI
Simbie AI is your ideal, clinically intelligent and trained, call center, receptionist and medical assistant all in one.
2-10 employees
Funding
Current Stage
Early StageTotal Funding
$0.5MKey Investors
Y Combinator
2023-09-06Pre Seed· $0.5M
Leadership Team
Natalia Neha Khosla, MD, MSc
Co-founder, CEO
Natalia Perina
Co-Founder
Company data provided by crunchbase