JobsPassport · 2 months ago
In-Country Cultural & Linguistic Expert- Cloud
United States
Full-time, Contract
Remote
Senior Level
5+ years expJobsPassport is seeking an In-Country Cultural & Linguistic Expert for a remote position in the USA. The role involves generating training and evaluation sets for AI, benchmarking responses for cultural appropriateness, and conducting structural bias analysis.
Computer Software
Responsibilities
Generate Training Sets: Create and review texts that reflect the real world, including authentic local conversations, idioms, proverbs, and common knowledge. You'll craft natural dialogues, stories, and Q&A pairs that an AI couldn't learn from textbooks alone
Create Evaluation Sets: Design challenging prompts to test the LLM's grasp of cultural nuance, humor, taboos, and sensitive topics. Your insights will help us understand the subtle difference between a culturally appropriate response and an offensive one
Benchmark AI Responses: Act as a human evaluator to score our LLM's outputs on cultural appropriateness, factual accuracy, and tone. You'll identify the subtle biases, stereotypes, and inaccuracies that only a cultural insider can spot
Framework Development: Help define "cultural awareness". You will participate in development of guidelines and intellectual frameworks for teams to structure the data generation and evaluation
Data Vetting & Enrichment: Review datasets to ensure they cover a comprehensive range of cultural phenomena. You will provide deeper context, connecting specific examples to broader theories of cultural values (e.g., individualism vs. collectivism, high-context vs. low-context communication)
Structural Bias Analysis: Use your academic expertise to identify and categorize potential sources of cultural bias at a structural level. You will help us understand and mitigate historical, social, and linguistic biases within our models
Qualification
Required
You are a native speaker of [Target Language] and are currently living in or have deep, recent experience with the [Target Culture]
You hold an advanced degree (PhD preferred) in a relevant field such as Sociolinguistics, Anthropology, Sociology, History, or Cultural Studies
You have a profound understanding of the social dynamics, customs, and current events in your region
You possess strong communication skills and a keen eye for detail
Your background might be in writing, journalism, local education, community leadership, or another field that requires rich cultural immersion
You possess knowledge on a wide range of demographics within your culture (e.g., different ages, genders, regions, urban vs. rural, and socioeconomic backgrounds)
You have deep domain knowledge of cultural values, social structures, kinship, rituals, and the historical context of one or more specific cultures
Company
JobsPassport
JobsPassport Breaking barriers, connecting talents worldwide! Jobs Passport is a one-stop international recruitment portal that connects potential talent with business organizations looking forward to building a diverse, inclusive & competitive workforce with global talent.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase