Apply on Employer Site

USAJOBS · 1 month ago

IT Specialist (AI)

Multiple Locations, USA

Full-time

Onsite

Mid, Senior Level

$121K/yr - $195K/yr

1+ years exp

USAJOBS is seeking an IT Specialist (AI) to join NIST, which works with industry and science to advance innovation and improve quality of life. The role involves evaluating AI systems' functionality and trustworthiness, developing scientific methods for assessment, and collaborating on innovative solutions to AI evaluation challenges.

ConsultingGovernmentHuman ResourcesInformation TechnologyInternetStaffing Agency

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

Evaluate and assess the functionality and trustworthiness of AI models in compliance with the AI Action Plan

Design methods for scientifically sound evaluations of AI systems

Evaluate AI systems in application, post-deployment, and in real world settings

Develop methods, tooling, and guidelines for rigorous evaluation of end-to-end AI systems in use (e.g., in the workplace and/or in sector-specific tasks) to identify failure modes and areas of un-reliability

Develop analyses of evaluations and AI measurement instruments, themselves, for example evaluation and improvement of red teaming, benchmarks, and automated scoring techniques

Adapt and improve evaluation techniques, and develop new techniques where needed

Collaborate with colleagues and across teams to develop innovative solutions to AI evaluation problems

Communicate complex AI concepts to both technical and non-technical audiences

Inform the development of technical guidelines and best practices for AI evaluation

Qualification

AI generative modelsMachine Learning algorithmsTechnical evaluation methodsCross-functional collaborationCustomer ServiceAttention to DetailOral CommunicationProblem Solving

Required

U.S. citizenship

Males born after 12-31-59 must be registered for Selective Service

Suitable for Federal employment

Completion of Confidential Financial Disclosure, Form OGE-450

Designated and/or random drug testing required

Experience must be IT related; the experience may be demonstrated by paid or unpaid experience and/or completion of specific, intensive training (for example, IT certification), as appropriate

Attention to Detail - Is thorough when performing work and conscientious about attending to detail

Customer Service - Works with clients and customers to assess their needs, provide information or assistance, resolve their problems, or satisfy their expectations

Oral Communication - Expresses information to individuals or groups effectively, taking into account the audience and nature of the information

Problem Solving - Identifies problems; determines accuracy and relevance of information; uses sound judgment to generate and evaluate alternatives, and to make recommendations

ZP-2210-IV: In addition to the basic requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-12 level (ZP-III at NIST). Specialized experience is defined as experience demonstrating technical understanding of Artificial Intelligence (AI) generative models and Machine Learning (ML) algorithms; designing scientifically sound technical evaluation methods in real settings; carrying out rigorous technical evaluations to identify functionality and reliability issues; and collaborating and coordinating on AI-related projects

ZP-2210-V: In addition to the above requirements, applicants must have one year (52 weeks) of specialized experience equivalent to at least the GS-14 level (ZP-IV at NIST). Specialized experience is defined as experience demonstrating advanced technical understanding of Artificial Intelligence (AI) generative models and Machine Learning (ML) algorithms; designing scientifically sound technical evaluation methods in real settings; carrying out rigorous technical evaluations to identify functionality and reliability issues; and leading cross-functional AI-related teams and projects