KAPS Solutions · 1 week ago
Health Data Scientist
KAPS Solutions is a leading small business provider of business consulting services within the DoD and Intelligence Community. They are seeking a Health Data Scientist to support the Advanced Research Projects Agency – Health by providing expert guidance in health data, AI evaluation, and clinical practice, ensuring datasets and evaluation methods are scientifically rigorous and clinically grounded.
ConsultingCRMCyber SecurityTraining
Responsibilities
Lead and advise on the design, preparation, and validation of healthcare datasets used across the program, including EHR, genomic, and multimodal data
Define and assess evaluation strategies and benchmarks that are clinically realistic, methodologically sound, and resistant to shortcut learning or leakage
Review technical proposals, model submissions, and evaluation results from external teams, providing expert feedback on validity, risks, and interpretability
Assess data quality, representativeness, and bias, and advise on mitigation strategies appropriate to rare disease contexts
Evaluate alignment between technical performance metrics and clinical decision-making needs, working closely with clinical SMEs
Identify gaps between benchmark performance and real-world applicability, and advise on corrective actions
Serve as a technical bridge between AI developers, clinical experts, and program leadership
Support the program manager with technical assessments, recommendations, and decision support related to data and evaluation
Track progress of external partners and identify data- or evaluation-related risks that could impact program outcomes
Produce high-quality written reports, analyses, and presentations that communicate technical findings to diverse audiences
Qualification
Required
PhD in Biomedical Informatics, Data Science, Biostatistics, or a related field
5+ years of experience working with healthcare or biomedical data in applied or evaluative roles
Hands-on experience with EHR, genomic, or multimodal healthcare datasets
Deep understanding of AI/ML evaluation methods, including benchmarking, robustness, and sources of bias or leakage
Demonstrated ability to critically review and assess technical work across health data and AI domains
Strong understanding of data governance, privacy, and compliance in healthcare contexts
Excellent written and verbal communication skills, with experience producing high-quality technical materials
Domain expertise in rare disease, diagnostics, or clinical decision support
Prior experience in technical advisory, evaluation, or SETA-style roles
Experience collaborating closely with clinicians and healthcare stakeholders
Experience working in fast-paced, multi-stakeholder, or early-stage environments
Benefits
401(k)
401(k) matching
Dental insurance
Employee assistance program
Employee discount
Health insurance
Health savings account
Life insurance
Paid time off
Parental leave
Professional development assistance
Referral program
Retirement plan
Tuition reimbursement
Vision insurance