Apply on Employer Site

Productive Playhouse · 1 month ago

Indonesian AI Model Rater

United States

Full-time

Remote

Mid Level

$12/hr - $12/hr

Productive Playhouse is a global data company focused on language and data services. They are seeking experienced Indonesian speakers to join their AI Model Rater project, which involves evaluating AI-generated outputs and ensuring accurate integration with digital services through APIs.

BroadcastingFilmMedia and Entertainment

No H1B

Responsibilities

Analyze and rate AI-generated responses and their associated tool outputs against a detailed set of quality guidelines

Verify that the AI successfully integrates information from different digital services (APIs) as required by the prompt

Evaluate the accuracy, completeness, and overall quality of the AI's response and tool execution

Follow provided instructions to achieve task goals, with all evaluations recorded in English

Qualification

APIsFluency in IndonesianComprehension of EnglishTechnical guideline adherenceDetail-oriented

Required

Advanced/Expert fluency in Indonesian language, as spoken in the Indonesia region (ISO: [id_id])

Strong comprehension of English (read and write)

Strong conceptual knowledge of APIs and digital services (ability to understand how AI tools interact with external apps like search, maps, or calendar, without needing to write code)

Ability to follow complex technical guidelines precisely

All participants must have, or be willing to create, an Upwork account

Applicants must pass a quick skill verification assessment (MC, duration ~10 minutes)

Work must be performed on participant's own devices

You must use your own laptop, and smartphone (if required)

A Gmail account may be required to access certain tools. If you do not have a Gmail account, you must be willing to create one

Using AI during the assessment and work is STRICTLY forbidden, and results/inputs will be monitored to detect AI usage