Keystone Recruitment · 13 hours ago
Principal Quantitative Strategist
United States
Contract
Remote
Lead/Staff
$73.29/hr - $73.29/hrKeystone Recruitment is working with a leading AI research organization focused on enhancing conversational AI systems. The Principal Quantitative Strategist will evaluate and improve AI models' reasoning in mathematical contexts, ensuring correctness and clarity in model outputs.
Staffing & Recruiting
No H1B
Responsibilities
Write and refine prompts to guide AI model behavior in mathematical contexts
Evaluate large language model (LLM) responses to mathematics-related queries for correctness, rigor, and logical coherence
Verify mathematical claims, derivations, and proofs using deep domain expertise
Conduct fact-checking using authoritative public sources and mathematical knowledge
Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors
Assess clarity, structure, and suitability of explanations for different audience levels
Ensure outputs align with expected conversational standards and evaluation guidelines
Apply consistent evaluation frameworks, benchmarks, and taxonomies across tasks
Qualification
Required
PhD in Mathematics or a closely related field
Demonstrated expertise in Probability & Statistics, with experience in one or more of the following areas: Algebra & Number Theory, Calculus & Analysis, Geometry & Topology, Discrete Mathematics, Logic & Computation
Comfortable working with large language models and understanding real-world usage patterns
Excellent written communication skills with the ability to explain complex concepts clearly
Strong attention to detail and ability to identify subtle logical or conceptual issues
Experience reviewing, editing, or evaluating technical or academic writing
Preferred
Prior experience with RLHF, model evaluation, or data annotation
Teaching, mentoring, or explaining mathematics to non-expert audiences
Familiarity with structured evaluation rubrics, benchmarks, or review frameworks
Benefits
Engagement as an independent contractor
Fully remote with flexible scheduling
Payments are issued weekly via Stripe or Wise based on services rendered
Company
Keystone Recruitment
Great companies are built on strong people. At Keystone Recruitment, we identify the pivotal talent that holds your organisation together.
11-50 employeesFunding
Current Stage
Early StageCompany data provided by crunchbase