Fluency · 6 hours ago
Research Engineer
San Francisco, CA
Full-time
Onsite
Mid, Senior Level
$150K/yr - $250K/yrFluency is enabling the autonomous Enterprise and is seeking a Research Engineer to design experiments, build evaluation infrastructure, and drive model quality for enterprise intelligence. The role involves developing methodologies for model evaluation and improving AI impact analysis across Fortune 500 organizations.
Artificial Intelligence (AI)SaaS
No H1B
Responsibilities
Designing evaluation pipelines that measure accuracy, precision, and recall across classification tasks
Building ground truth datasets from ambiguous, real-world enterprise data
Running systematic prompt engineering experiments to optimise LLM performance
Developing A/B testing infrastructure for model comparison
Researching novel approaches to process understanding, activity classification, and intent extraction
Quantifying cost-accuracy tradeoffs across different model architectures and prompting strategies
Qualification
Required
Strong Python fundamentals and software engineering discipline
LLM prompt engineering and optimisation (token efficiency, few-shot design, chain-of-thought)
Experience evaluating model performance: accuracy measurement, error analysis, regression detection
Ability to read, synthesise, and apply ML research papers
Statistical literacy: understanding when results are meaningful vs noise
Comfort with ambiguity and novel problem domains
Computer Science Background, with caveat. If you don't have a CS background, you're challenged to beat one of the founders in a 1:1 whiteboard duel on DS&A judged by Hung
Preferred
Experience building evaluation frameworks and benchmarking systems
Ground truth dataset creation and annotation pipeline experience
Experience with hybrid LLM/rule-based systems
OCR, document understanding, or computer vision background
Cost optimisation for LLM-heavy systems
Classification and NLP systems experience
Published research or formal research methodology training
Familiarity with process mining or workflow analysis
Interesting personal projects that demonstrate depth
Benefits
Substantial equity, every offer includes ownership
Mac, Linux, or Windows, your call
Company
Fluency
Developer of an AI-powered SaaS platform for automatically generated documentation, task intelligence, and executive insights.
Founded in 2023
2-10 employees
Funding
Current Stage
Early StageTotal Funding
$1.16MKey Investors
Brad TaboneSwinburne University of Technology
2025-04-29Pre Seed· $0.96M
2023-12-10Pre Seed· $0.2M
Recent News
Paypers
2025-05-07
Morningstar.com
2025-05-06
thesaasnews.com
2025-04-29
Company data provided by crunchbase