SIGN IN
Labeler / Annotator – AI Response Evaluation (French) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Blueprint · 1 month ago

Labeler / Annotator – AI Response Evaluation (French)

positionUnited States
timeFull-time
remoteRemote
seniorityEntry Level
money$2,400,000/mo - $2,720,000/mo
Blueprint Technologies is a technology solutions firm headquartered in Bellevue, Washington, focused on solving complex problems with technology. They are seeking a detail-oriented Labeler / Annotator to evaluate responses generated by AI systems in French, specifically through side-by-side evaluation of AI outputs across various scenarios.
ConsultingInformation TechnologySoftware
check
H1B Sponsor Likelynote

Responsibilities

Perform side-by-side (SBS) comparisons of AI-generated responses
Evaluate outputs based on:
Accuracy
Relevance
Clarity
Instruction-following
Identify nuances in tone, meaning, and cultural context across French
Apply detailed, scenario-specific annotation guidelines
Maintain consistency and high-quality evaluations

Qualification

Side-by-side (SBS) labelingData annotationAI evaluationSearch relevance analysisFrench language fluencyEnglish reading comprehension

Required

Native or professional fluency in French
Strong English reading comprehension (required for guidelines)
Prior experience with side-by-side (SBS) labeling or annotation
Excellent analytical thinking and attention to detail
Ability to quickly understand and apply structured evaluation frameworks

Preferred

Background in linguistics, translation, or localization
Experience in AI evaluation
Experience in data annotation
Experience in search relevance or content quality analysis

Benefits

Statutory benefits (e.g., paid vacation and aguinaldo / Sueldo Anual Complementario (SAC))
Social security contributions and healthcare coverage (Obra Social)
Additional benefits aligned with local market practices

Company

Blueprint

linkedincrunchbase
Glassdoor3.1
company-logo
Blueprint is redefining the data solutions ecosystem.
dateFounded in 2013
location
Bellevue, Washington, USA
people-size501-1000 employees
web-link
https://bpcs.com/

H1B Sponsorship

Blueprint has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
44%
Represents job field similar to this job
Engineering and Development
Customer Service and Support
Management and Executive
Legal and Compliance
Trends of Total Sponsorships
*2025 (3)
2024 (1)
2023 (1)
2021 (3)
2020 (1)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Gary Nakanelua
Managing Director, Product & Innovation
linkedin

Recent News

PR Newswire
Blueprint and Superblocks Announce Strategic Partnership to Accelerate Enterprise Application Development and AI Innovation
2026-02-03
PR Newswire
Blueprint Technologies Recognized in Seven 2025 Gartner® Hype Cycle™ Reports for Role in Augmented FinOps
2025-07-29
Business Wire
Sigma and Blueprint Technologies Announce Strategic Partnership to Accelerate Data-Driven Innovation in the Databricks Ecosystem
2025-06-11
Company data provided by crunchbase