Crossing Hurdles · 1 day ago
English & Brazilian Portuguese Generalist | $19.95/hr Remote
United States
Contract
Remote
New Grad, Entry Level
$19.95/hr - $19.95/hrCrossing Hurdles is seeking a Generalist fluent in English and Brazilian Portuguese to evaluate AI-generated responses. The role involves conducting fact-checking, generating evaluation data, and ensuring outputs meet conversational standards.
Staffing & Recruiting
Hiring Manager
Sankalp Chhabra
Responsibilities
Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across diverse topics
Conduct fact-checking using trusted public sources and external tools
Generate high-quality human evaluation data by annotating response strengths, gaps, and factual inaccuracies
Assess reasoning quality, clarity, tone, and completeness of AI-generated responses
Ensure outputs align with expected conversational behavior and system guidelines
Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks
Qualification
Required
Bachelor's degree completed
Native-level or near-native fluency in Brazilian Portuguese (ILR 5 / CEFR C2) with strong English proficiency
Proven experience using large language models and understanding real-world LLM usage
Excellent writing skills with the ability to provide clear, nuanced, and structured feedback
Strong attention to detail and analytical thinking abilities
Comfortable working across multiple topics, domains, and evolving requirements
Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering
Strong college-level mathematics skills
Company
Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals.
Founded in 2022
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase