Apply on Employer Site

Great Value Hiring · 1 day ago

Legal Specialist

United States

Contract

Remote

Senior Level

$105/hr - $105/hr

5+ years exp

Great Value Hiring is seeking a Legal Specialist to evaluate and improve conversational AI systems in finance-related queries. The role involves writing prompts, evaluating responses for accuracy and clarity, and ensuring model responses meet conversational behavior standards.

Staffing & Recruiting

Responsibilities

Write and refine prompts to guide model behavior in financial contexts

Evaluate LLM-generated responses to finance-related user queries for accuracy, reasoning quality, and clarity

Conduct fact-checking using trusted public sources, financial references, and external tools

Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies

Assess tone, completeness, and appropriateness of responses for real-world financial use cases

Ensure model responses align with expected conversational behavior and system guidelines

Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines

Qualification

Legal expertiseLLMsFact-checkingWriting skillsModel evaluationData annotationTranslating legal concepts

Required

Minimum of 5 years of real-world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent)

Experience in one or more of the following sub-domains: Corporate, Business & Commercial Law, Employment, Labor & Human Rights, Public, Criminal & International Governance, Private Law

Significant experience using large language models (LLMs) and understand how and why people use them

Excellent writing skills and can clearly explain complex financial concepts

Comfortable evaluating complex arguments and identifying subtle reasoning or detail-level issues that others may overlook