National Institute of Standards and Technology (NIST) · 21 hours ago
AI Research Scientist, Applied Systems
San Francisco, CA
Full-time
Onsite
Senior Level
5+ years expNational Institute of Standards and Technology (NIST) is seeking a research scientist to design and execute rigorous research analyzing AI systems in real-world settings. The role involves identifying impactful research areas, conducting evaluations, and developing guidelines to support good practices in AI measurement and innovation.
GovernmentLife ScienceNanotechnology
No H1B
U.S. Citizen Only
Responsibilities
Identify new, impactful research areas and questions with a focus on evaluating AI systems in real settings, such as use in businesses, federal agencies, and other organizations
Design and conduct rigorous evaluations and analyses, leveraging methodologies from a range of fields
Perform data analysis to synthesize and visualize research findings and evaluation results
Develop guidelines and tooling that can be open-sourced to support good practice (e.g., in the federal government)
Adapt and improve existing evaluation techniques, and develop novel, rigorous techniques where needed
Write research publications and publicize findings via blog posts, guidance, and briefings
Communicate complex AI topics and research findings in a compelling and clear manner to a range of audiences from subject matter experts to practitioners to non-technical decision makers
Be a force multiplier, supporting work across the Applied Systems team and CAISI, mentoring new hires and interns, and contributing to an innovative and dynamic information environment
Qualification
Required
Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific, intensive training (for example, IT certification), as appropriate
Attention to Detail - Is thorough when performing work and conscientious about attending to detail
Customer Service - Works with clients and customers to assess their needs, provide information or assistance, resolve their problems, or satisfy their expectations; knows about available products and services; is committed to providing quality products and services
Oral Communication - Expresses information to individuals or groups effectively, taking into account the audience and nature of the information; makes clear and convincing oral presentations; listens to others, attends to nonverbal cues, and responds appropriately
Problem Solving - Identifies problems; determines accuracy and relevance of information; uses sound judgment to generate and evaluate alternatives, and to make recommendations
ZP-2210-IV: In addition to the basic requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-12 level (ZP-III at NIST). Specialized experience is defined as advanced technical understanding of generative artificial intelligence (AI) models and machine learning (ML) algorithms; demonstrated experience analyzing and evaluating AI systems; a track record of authorship on high-quality, peer-reviewed research; experience capably carrying out rigorous, cutting-edge research from start to finish
ZP-2210-V: In addition to the above requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-14 level (ZP-IV at NIST). Specialized experience is defined as advanced technical understanding of generative artificial intelligence (AI) models and machine learning (ML) algorithms; demonstrated experience analyzing and evaluating AI systems; a track record of authorship on high-quality, peer-reviewed research; have not only contributed to, but designed and led rigorous, cutting-edge AI evaluation research from start to finish
Company
National Institute of Standards and Technology (NIST)
We are the National Institute of Standards and Technology (NIST), a non-regulatory federal agency within the U.S. Department of Commerce.
1001-5000 employees
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
U.S. Department of Homeland Security
2023-01-17Grant
Leadership Team
George Jenkins, CPA, MBA, FAC-P/PM
Chief Financial Officer
Anita Vanek
Deputy Chief Operating Officer
Recent News
Help Net Security
2025-12-22
2025-12-18
NYT > Technology
2025-12-06
Company data provided by crunchbase