Filevine · 4 days ago
QA Engineer (AI Forms Platform)
United States
Full-time
Remote
Mid Level
3+ years expFilevine is forging the future of legal work with cloud-based workflow tools, and they are seeking a forward-thinking QA Engineer to lead the testing strategy for their new AI-first Forms Platform. The role involves building evaluation harnesses for AI models, automating tests, and ensuring the quality of complex legal forms during migration from legacy systems.
Artificial Intelligence (AI)Document ManagementLegal TechProject ManagementSaaSSoftware
Responsibilities
AI Model Validation: Design and maintain evaluation harnesses (evals) to measure the accuracy of AI auto-mapping models, ensuring they meet strict quality thresholds before release
Test Automation: Build robust, automated test suites (end-to-end and integration) that run within our CI/CD pipelines to catch regressions immediately
Golden Datasets: Maintain and expand "golden datasets" of perfectly mapped forms to serve as the ground truth for regression testing
Defect Prevention: Collaborate with developers to identify "model quality variance" and implement gates that prevent low-confidence predictions from reaching production
Migration Quality: Verify data integrity during the migration of pilot customers from the legacy platform to the new architecture
Efficiency: Leverage LLMs and AI coding assistants to rapidly write test scripts and generate edge-case scenarios for complex legal forms
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or related field
3+ years of experience in QA Automation, with proficiency in tools like Cypress, Selenium, or Playwright
Strong ability to write test scripts in JavaScript, TypeScript, or Python (Java/C++ proficiency also accepted)
Experience testing non-deterministic systems (AI/ML models) or complex data migration projects is highly preferred
1 to 3 years experience working in agile environments with frequent release cycles
Demonstrated ability to use AI tools to solve coding roadblocks and optimize testing workflows
Excellent verbal and written communication skills to articulate quality risks to the product team
Preferred
Experience testing non-deterministic systems (AI/ML models) or complex data migration projects is highly preferred
Benefits
Medical, Dental, & Vision Insurance (for full-time employees)
Competitive & Fair Pay
Maternity & paternity leave (for full-time employees)
Short & long-term disability
Opportunity to learn from a dedicated leadership team
Centrally located open office building in Sugar House (onsite employees)
Top-of-the-line company swag
Company
Filevine
Filevine provides a legal operating platform integrating AI for case, document, and lead management.
501-1000 employees
Funding
Current Stage
Late StageTotal Funding
$636.08MKey Investors
Insight PartnersStepStone GroupSignal Peak Ventures
2025-09-23Series E· $260M
2024-06-01Series Unknown· $150M
2022-04-14Series D· $108M
Leadership Team
Nathan Morris
Co-Founder and Chief Culture Officer
Jonathan Ord
Board Member
Recent News
LegalTech Breakthrough
2025-11-14
Company data provided by crunchbase