USAJOBS · 6 hours ago
AI Evaluations Scientist, Biological AI Models
Multiple Locations, USA
Full-time
Onsite
Mid, Senior Level
$122K/yr - $197K/yr
1+ years expThe NIST Center for AI Standards and Innovation (CAISI) is seeking a candidate who will design, develop, and execute national security-related evaluations of frontier biological AI models in accordance with the AI Action Plan. This role involves adapting biological AI models for evaluation and collaborating with cross-functional teams of biology, machine learning, and policy experts.
ConsultingGovernmentHuman ResourcesInformation TechnologyInternetStaffing Agency
No H1B
Security Clearance RequiredU.S. Citizen Only
Responsibilities
Design, develop, and execute national security-related evaluations of frontier biological AI models, such as biological language models and biomolecular modeling and design tools
Adapt biological AI models for evaluation purposes
Curate relevant benchmarks and ground-truth datasets
Develop and refine scalable software workflows, custom tooling, and evaluation pipelines
Quantify uncertainty and statistical significance of evaluation results
Analyze biosecurity/national security implications of demonstrated model capabilities
Continuously adapt evaluation strategies to align with the state-of-the-art AI architectures and modalities
Collaborate with cross-functional teams of biology, machine learning, and policy subject matter experts
Communicate complex technical findings to technical and non-technical stakeholders
Qualification
Required
U.S. citizenship
Males born after 12-31-59 must be registered for Selective Service
Suitable for Federal employment
Completion of Confidential Financial Disclosure, Form OGE-450
Designated and/or random drug testing required
Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific, intensive training (for example, IT certification), as appropriate
Attention to Detail - Is thorough when performing work and conscientious about attending to detail
Customer Service - Works with clients and customers to assess their needs, provide information or assistance, resolve their problems, or satisfy their expectations
Oral Communication - Expresses information to individuals or groups effectively, taking into account the audience and nature of the information
Problem Solving - Identifies problems; determines accuracy and relevance of information; uses sound judgment to generate and evaluate alternatives, and to make recommendations
ZP-2210-IV: In addition to the basic requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-12 level (ZP-III at NIST). Specialized experience is defined as experience conducting research related to biological Artificial Intelligence (AI)/Machine Learning (ML) modeling approaches
ZP-2210-V: In addition to the above requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-14 level (ZP-IV at NIST). Specialized experience is defined as experience demonstrating exceptional leadership in research related to biological Artificial Intelligence (AI)/Machine Learning (ML) modeling approaches
Benefits
A career with the U.S. government provides employees with a comprehensive benefits package. As a federal employee, you and your family will have access to a range of benefits that are designed to make your federal career very rewarding.
Company
USAJOBS
USAJOBS enables federal job seekers to access job opportunities across hundreds of federal agencies and organizations.
10001+ employees
Funding
Current Stage
Late StageRecent News
Company data provided by crunchbase