hackajob · 4 hours ago
Generalist - English & Spanish (Train AI Models Part Time!)
United States
Part-time, Contract
Remote
New Grad, Entry Levelhackajob is collaborating with Mercor to connect them with exceptional tech professionals for this role. This position involves evaluating and improving general chat behavior in large language models by assessing model-generated responses and providing high-quality human feedback.
Artificial Intelligence (AI)Generative AIHuman ResourcesRecruitingSoftware
Responsibilities
Evaluate LLM-generated responses on their ability to effectively answer user queries
Conduct fact-checking using trusted public sources and external tools
Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
Assess reasoning quality, clarity, tone, and completeness of responses
Ensure model responses align with expected conversational behavior and system guidelines
Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Qualification
Required
Fluent Language Skills Required: English & Spanish
You hold a Bachelor's degree
You are a native speaker or have ILR 5/primary fluency (C2 on the CEFR scale) in Spanish
You have significant experience using large language models (LLMs) and understand how and why people use them
You have excellent writing skills and can clearly articulate nuanced feedback
You have strong attention to detail and consistently notice subtle issues others may overlook
You are adaptable and comfortable moving across topics, domains, and customer requirements
You have a background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
You have excellent college-level mathematics skills
Preferred
Prior experience with RLHF, model evaluation, or data annotation work
Experience writing or editing high-quality written content
Experience comparing multiple outputs and making fine-grained qualitative judgments
Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
Benefits
Flexible, remote contract work
Competitive contract rates
Company
hackajob
The AI-native tech hiring platform trusted by enterprises, scale-ups, and 1M+ tech professionals worldwide.
Founded in 2014
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$33MKey Investors
Volition CapitalDowning VenturesTechstars
2023-05-03Series B· $25M
2018-10-25Series A· $6.7M
2017-03-31Seed· $0.58M
Leadership Team
Mark Chaffey
CEO
Phil Kell
VP - Marketplace
Recent News
2025-10-23
2025-09-26
2025-09-12
Company data provided by crunchbase