Crossing Hurdles ยท 16 hours ago
English & French Language Quality Analyst | $36.16/hr | Remote
Crossing Hurdles is seeking a Generalist for English & French language quality analysis. The role involves evaluating AI-generated responses for accuracy and effectiveness, creating human evaluation data, and ensuring adherence to conversational guidelines.
Staffing & Recruiting
Responsibilities
Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across a wide range of topics
Perform fact-checking using reliable public sources and external tools
Create high-quality human evaluation data by annotating response strengths, gaps, and factual errors
Assess reasoning quality, tone, clarity, and completeness of AI-generated outputs
Ensure responses follow expected conversational behavior and system guidelines
Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks
Qualification
Required
Bachelor's degree completed
Native-level or near-native fluency in French (ILR 5 / CEFR C2) with strong English proficiency
Proven experience using large language models and understanding real-world LLM use cases
Excellent writing skills with the ability to provide clear, nuanced, and structured feedback
Strong attention to detail and analytical thinking
Ability to work across multiple topics, domains, and evolving requirements
Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering
Strong college-level mathematics skills
Company
Crossing Hurdles
At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals.
Funding
Current Stage
Early StageCompany data provided by crunchbase