VARITE INC · 10 hours ago
Software Specialist
VARITE INC is a multinational technology and e-commerce company based in the United States, widely recognized as one of the world's largest online retailers. The role involves critically analyzing and evaluating code responses generated by LLMs, selecting efficient code solutions, and collaborating with the AI research team to improve coding capabilities.
Information Technology & Services
Responsibilities
Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
Qualification
Required
Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms
Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
Make informed decisions on behalf of our customers, ensuring that selected code meets industry standards, best practices, and specific client needs
Develop and write coding demonstrations to illustrate 'what good looks like' in AI-generated code, setting benchmarks for quality and efficiency
Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge
Benefits
Candidate Referral program
Experience Level Bonus Referral