AI Evaluation Experts | $70/hr Remote jobs in United States
cer-icon
Apply on Employer Site
company-logo

Crossing Hurdles ยท 1 day ago

AI Evaluation Experts | $70/hr Remote

Crossing Hurdles is seeking an Expert Prompt Curator for their Advanced AI Evaluation Dataset. The role involves designing original prompts that require advanced reasoning, testing these prompts against AI systems, and collaborating with reviewers to ensure quality.

Staffing & Recruiting

Responsibilities

Design original, expert-level prompts that require advanced reasoning and external tool usage
Create prompts that are objective, self-contained, and produce clear, unambiguous answers
Test prompts against advanced AI systems and document failures or limitations
Provide complete reasoning steps and correct solutions for each prompt
Classify prompts by subject domain for structured dataset organization
Collaborate asynchronously with reviewers to refine and validate prompt quality

Qualification

Advanced domain expertiseQuestion design experienceAI model familiarityAttention to detailClear documentation

Required

Advanced academic or professional expertise in a specialized domain
Strong ability to design high-difficulty questions requiring deep subject knowledge
Experience with research, benchmarking, or test question design
High attention to detail and ability to document reasoning clearly

Preferred

Familiarity with AI models and their limitations is a plus

Company

Crossing Hurdles

twitter
company-logo
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals.

Funding

Current Stage
Early Stage
Company data provided by crunchbase