G3 · 1 week ago
Raters for GenAI Data - US
United States
Full-time
Remote
New Grad, Entry LevelG3 is a part of the TransPerfect family, which provides language and technology solutions globally. They are seeking native speakers and cultural experts to assist in Generative AI data creation and evaluation projects, ensuring the accuracy and cultural relevance of AI responses.
ConsultingTranslation Service
Responsibilities
Generate Training Sets: Create, expand, and review culturally authentic content, including natural language queries, prompts, idiomatic expressions, and real-world conversational examples
Create Evaluation Sets: Design culturally nuanced prompts to test AI systems on humor, sensitive topics, taboos, regional variation, and social context
Benchmark AI Responses: Evaluate model outputs for cultural appropriateness, tone, factual accuracy, bias, and overall quality, providing detailed and actionable feedback
Query Vetting & Fact Checking: Conduct in-depth research to verify accuracy, precision, and recall, ensuring content meets high factual and informational standards
Framework & Workflow Development: Translate high-level research requirements into detailed workflows, helping define cultural evaluation standards and best practices
Data Vetting & Enrichment: Review and enrich datasets to ensure they represent diverse cultural perspectives across regions, demographics, and socioeconomic contexts
Bias Analysis & Ethical Review: Identify, categorize, and document cultural, social, and ethical biases in AI outputs, contributing to bias mitigation and responsible AI development
Cross-Functional Collaboration: Work closely with AI researchers, engineers, and peer reviewers to maximize data quality, throughput, and impact
Qualification
Required
Candidates must demonstrate native or bilingual proficiency, or full professional proficiency, in reading and writing in at least one of the following languages: English – Native of the United States or United Kingdom, Portuguese – Native of Brazil, Japanese – Native of Japan, Turkish – Native of Turkey, German – Native of Germany
Graduate with distinction and demonstrated deep cultural knowledge
Degree obtained from a top-tier U.S. or international university or institute
Exceptional reading and writing proficiency in the target language, including mastery of grammar, syntax, style, and the ability to produce clear, concise, and engaging content across multiple formats (e.g., articles, blogs, technical documentation)
Strong research and fact-checking skills, with the ability to identify credible sources and meticulously verify information for accuracy and bias mitigation
High attention to detail, ensuring precision in language, data accuracy, and delivery of polished, error-free work
Excellent communication skills, with the ability to articulate ideas clearly, collaborate effectively with teams, and convey complex information to diverse audiences
Foundational understanding of AI and large language models (LLMs), including AI principles, machine learning, NLP, and model capabilities and limitations
Prompt review expertise, with the ability to assess and identify characteristics of effective, precise prompts that generate high-quality AI outputs
Familiarity with AI tools, including AI writing assistants and platforms used to generate, refine, and optimize content
Ethical AI awareness, including understanding of potential biases in AI systems and the implications of AI-generated content, with a focus on responsible and unbiased usage
Data literacy, including experience with data collection, preparation, cleaning, and transformation for LLM training
Company
G3
At G3, we go beyond translation—we enable businesses to thrive in a multilingual, multicultural world.
Founded in 2006
51-200 employees
H1B Sponsorship
G3 has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2022 (1)
2020 (2)
Funding
Current Stage
Growth StageLeadership Team
Nancy N. Hernon
CEO, Co-founder
John Labati
Chief Operating Officer
Company data provided by crunchbase