RLink Solutions · 2 days ago
Finance Manager
United States
Contract
Remote
Senior Level, Lead/Staff
12+ years expRLink Solutions is offering a freelance opportunity for a Finance Manager embedded within AI development. The role involves defining financial workflows, evaluating LLM performance on financial tasks, and guiding the creation of evaluation datasets and annotation workflows.
Information Technology & Services
Hiring Manager
Shreya Gupta
Responsibilities
Define real-world, research-driven financial workflows (e.g., M&A analysis, valuation, portfolio construction) and translate them into structured LLM evaluation workflows
Design rigorous evaluations, rubrics, and preference-ranking frameworks with clear inputs, expected outputs, and success criteria
Evaluate LLM performance on complex financial tasks including financial modeling within LLM workflows, data extraction, statement analysis, market interpretation, and risk assessment
Conduct deep error analysis, identify failure modes, loss patterns, and quality trends, and feed insights directly into model improvement or fine-tuning cycles
Guide evaluation dataset creation, annotation workflows, and human-in-the-loop processes (e.g., RLHF / preference optimization), working closely with product and engineering teams
Qualification
Required
Proven Domain Expertise: 12+ years of hands-on experience in Investment Banking, Private Equity, Asset Management, or Equity Research
Direct LLM Evaluation Experience (Non-Negotiable): Demonstrated experience in 3–4 or more of the following: LLM projects (hands-on, not high-level strategy), Model evaluation, preference ranking, or rubric design, Evaluation datasets and annotation workflows, Error analysis, failure modes, and quality trend tracking, Feedback loops into model improvement or fine-tuning, Human-in-the-loop / RLHF / preference optimization, Financial modeling embedded within LLM evaluations
Analytical Rigor: Ability to break complex financial reasoning into measurable, testable steps
Communication: Can clearly explain nuanced financial judgments to non-finance and technical audiences
Technical Acumen: Comfortable working closely with AI and engineering teams; understands how LLMs fail, not just how they work
Attention to Detail: High bar for accuracy, consistency, and evaluation quality
Company
RLink Solutions
Empowering Businesses Through Tailored IT Consulting | Experts in Digital Transformation, Cloud Computing, ERP Solutions & AI-Driven Innovation.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase