Freelance Coding QA Analyst jobs in United States
cer-icon
Apply on Employer Site
company-logo

Toloka · 10 hours ago

Freelance Coding QA Analyst

positionUnited States
timeFull-time
remoteRemote
seniorityMid Level

Toloka AI is a company that creates data powering leading GenAI models and innovations, working with various partners globally. They are seeking a detail-oriented Freelance Coding QA Analyst to manage testing and onboarding processes, ensuring quality standards in technical data annotation projects and providing insights for optimizing annotation pipelines.

AnalyticsArtificial Intelligence (AI)CrowdsourcingData Collection and LabelingMachine LearningSoftware

Responsibilities

Coordinate quality standards, guideline updates, and feedback loops across QAs, experts, and vendors to ensure consistent interpretation and execution
Coordinate coding pilot projects for new potential partners
Design unique pilot pipelines to test potential partners
Assign coding tasks ensuring alignment with agreed languages (primarily Python, Java, or JavaScript)
Create and manage collaboration platform spaces for partners during pilots and handle task-related queries
Ensure task designs allow for comparison of model-generated answers and prompt engineering assessment (when needed)
Prepare reports and recommendations to inform vendor and partnership decisions
Serve as the primary point of contact for partner and expert queries during pilot and production phases

Qualification

Software Quality AssurancePythonJavaJavaScriptTechnical vendor assessmentsStructured testing projectsAnalytical mindsetCollaboration platformsPrompt engineeringCommunication

Required

Experience in Software Quality Assurance or technical vendor assessments
Experience working with developer or documentation teams, high-volume review queues, and structured quality monitoring systems
Ability to deliver precise, objective feedback on code quality and logic to help developers align with project requirements
Strong understanding of coding languages (Python, Java, JS) and familiarity with additional or less common programming languages
Ability to create and manage structured testing projects and pipelines
Excellent communication skills for vendor interaction and cross-functional coordination
Comfortable using collaboration platforms and organizing technical documentation
Analytical mindset for assessing developer outputs and making recommendations

Preferred

Prior experience working with outsourcing teams in a technical capacity
Familiarity with prompt engineering and evaluating AI-generated code outputs

Benefits

Opportunity to work with cutting-edge AI technology and build your portfolio
Flexible working arrangements with ability to determine your own schedule
Long-term collaboration potential with a growing global tech company
Exposure to international markets and diverse audience segments

Company

Toloka

twittertwittertwitter
company-logo
Toloka offers a data-centric environment that supports fast and scalable AI development across the ML lifecycle.
dateFounded in 2014
location
Luzern, Luzern, CHE
people-size51-200 employees
web-link
https://toloka.ai/

Funding

Current Stage
Growth Stage
Total Funding
$72M
Key Investors
Bezos Expeditions
2025-05-06Series Unknown· $72M

Leadership Team

leader-logo
Olga Megorskaya
CEO of Toloka.ai
linkedin

Recent News

Morningstar.com
Tendem Introduces a New Standard for Getting Work Done Better and Faster with AI and Human Expertise
2025-11-19
Investor's Business Daily
Nebius Reports Bigger Q3 Net Income Loss, Announces Meta AI Deal
2025-11-11
Fierce Network
Neocloud newbie Nebius isn’t worried about AI bubble bursting
2025-11-06
Company data provided by crunchbase