Volga Partners · 4 weeks ago
AI Writing Evaluators (Domain Experts) - English Expertise
United States
Contract
Remote
Mid Level
$20/hr - $23/hrVolga Partners is a U.S.-based company specializing in Artificial Intelligence and machine learning for top technology giants. They are seeking AI Writing Evaluators (Domain Experts) to assess the writing capabilities of advanced AI models, requiring strong analytical and critical evaluation skills to create prompts and evaluate AI-generated responses.
ConsultingBig DataInformation TechnologySoftwareData MiningSoftware Engineering
Responsibilities
Prompt Development: Create structured prompts that incorporate domain-specific concepts, terminology, and professional context
AI Response Evaluation: Assess AI-generated outputs for:
Accuracy and factual correctness
Relevance to the given prompt
Clarity, coherence, and logical flow
Appropriate use of domain-specific language and tone
Feedback & Rating: Provide detailed feedback and ratings in accordance with project guidelines
Error Identification: Identify inconsistencies, gaps, or improvements required in AI responses
Quality Adherence: Ensure all evaluations meet the project's quality standards and evaluation frameworks
Qualification
Required
Must have strong subject‑matter expertise in Business Operations & Communications or Education and Academic Research
Must understand and be comfortable with the retainer model - you will be compensated for 8 hours per day regardless of task availability, provided you maintain the committed hours
Candidates must demonstrate US contextual understanding in writing and evaluation (location is not a factor)
Resources are required for a fixed 2‑week duration, with availability expected for 8 hours per day across the entire period
Must have reliable high-speed internet and a functioning device (laptop, desktop, etc.) to ensure seamless communication and productivity
Total expected contribution: Approximately 120 hours over the 2-3 weeks (8 hours/day × 5 days/week × 3 weeks)
Strong analytical and critical evaluation skills to assess the writing capabilities of advanced AI models such as ChatGPT, Claude, and Gemini
Create domain‑specific prompts and evaluate AI‑generated responses for accuracy, clarity, relevance, and contextual alignment
Provide detailed feedback and ratings in accordance with project guidelines
Identify inconsistencies, gaps, or improvements required in AI responses
Ensure all evaluations meet the project's quality standards and evaluation frameworks
Must be able to apply US‑based standards in writing and evaluation, regardless of physical location
Daily Commitment: 8 hours per day, Monday through Friday (or as scheduled), for the full 2‑week project duration
Must have own device (laptop/desktop)
Currently hiring for a retainer-based, fixed-term role (8 hours/day for 2 weeks)
Must have reliable high‑speed Wi‑Fi during working hours
This role is a 1099 independent contractor position (or local equivalent)
Successful completion of onboarding is required to begin work, which includes submitting the necessary documentation within the specified timeline
Expert-level written English
Strong logical reasoning and analytical skills
Ability to interpret structured evaluation rubrics
Attention to detail and ability to provide constructive, actionable feedback
Time management to maintain consistent daily availability
Strong academic or professional background in Business Operations & Communications OR Education and Academic Research
Proficiency in written English with a command of US contextual standards
Meticulous attention to detail
Ability to work independently and meet daily availability requirements
Must pass a project‑specific qualification assessment (writing sample and evaluation exercise)
Preferred
Familiarity with AI tools (ChatGPT, Claude, Gemini) is preferred but not mandatory
Proactive attitude toward continuous improvement and adherence to evaluation frameworks
Benefits
Paid 8 hours/day for the full 2 to 3‑week project duration, irrespective of task availability, provided the committed hours are maintained.
Flexibility to work remotely from any location.
1099 independent contractor position (or local equivalent).
Onboarding & Compliance Requirements: All global contractors will be onboarded through our platform, Gusto.com or Deel.com, to ensure alignment with international compliance standards.
Successful completion of onboarding is required to begin work, which includes submitting the necessary documentation within the specified timeline.
Company
Volga Partners
Volga Partners is an information technology firm that provides software development, data mining, analysis, testing, and staffing service.
Founded in 2020
1001-5000 employees
H1B Sponsorship
Volga Partners has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
67%
Represents job field similar to this job
Engineering and Development
Management and Executive
Trends of Total Sponsorships
*2023 (1)
2021 (1)
2020 (1)
Funding
Current Stage
Late StageLeadership Team
Juan Diego Ponce
Project Lead & Data Quality Analyst for Microsoft Bing at Volga Partners LLC
Volga Partners
Volga Partners Admin
Company data provided by crunchbase