Basis · 15 hours ago
Member of Technical Staff (All Levels) - Applied ML
New York, NY
Full-time
Onsite
Entry, Mid, Senior LevelBasis is a company that equips accountants with AI agents to enhance their workflows. They are seeking a Machine Learning Engineer who will own end-to-end projects and bring intelligence into production by designing and building systems that help agents reason, plan, and evaluate themselves.
AccountingArtificial Intelligence (AI)Information Technology
Responsibilities
Build and evolve our agent systems
Design and iterate multi-agent architectures that automate real accounting workflows
Build in autonomy boundaries, tool usage, and fallback behaviors that make agents safe and reliable
Manage context and memory for coherence across steps. Plan and execute agent loops with measurable success criteria
Route, evaluate, and optimize models under real-world constraints (latency, cost, accuracy)
Design evaluation and experimentation frameworks
Build scalable evaluation pipelines (offline and online) that run hundreds of experiments automatically
Define golden tasks, labeling strategies, and metrics that make performance measurable and comparable
Instrument the stack to detect regressions, track error patterns, and drive continuous improvement
Use data and experiments to drive product and architectural decisions, not just intuition
Engineer for context and retrieval
Build prompt stacks and instruction hierarchies that structure model reasoning
Create retrieval and indexing pipelines that surface relevant context efficiently
Parse messy documents into structured representations that agents can understand
Design guardrails and validation layers to keep behavior safe and predictable
Operate as an RP: plan, build, deliver
Scope your projects clearly. Write concise specs and architecture docs that eliminate ambiguity
Build, test, and instrument your systems end-to-end
Communicate progress clearly: what's built, what's learned, what's next
Work closely with your pod, teaching, unblocking, and sharing learnings as you go
Qualification
Required
Experience in building and evolving multi-agent architectures that automate workflows
Ability to design and iterate on systems with autonomy boundaries, tool usage, and fallback behaviors
Experience managing context and memory for coherence across steps
Ability to route, evaluate, and optimize models under real-world constraints (latency, cost, accuracy)
Experience building scalable evaluation pipelines (offline and online) that run experiments automatically
Ability to define golden tasks, labeling strategies, and metrics for performance measurement
Experience in instrumenting systems to detect regressions and track error patterns
Ability to use data and experiments to drive product and architectural decisions
Experience in building prompt stacks and instruction hierarchies for model reasoning
Ability to create retrieval and indexing pipelines for efficient context surfacing
Experience parsing messy documents into structured representations
Ability to design guardrails and validation layers for safe and predictable behavior
Experience in scoping projects clearly and writing concise specs and architecture documents
Ability to build, test, and instrument systems end-to-end
Strong communication skills to convey progress and learnings
Ability to work closely with team members, teaching and sharing insights
Benefits
Premium Medical, Dental, and Vision coverage
Life Insurance
6 coaching & 6 therapy sessions through Spring Health
Unlimited PTO + 12 paid company holidays
Daily meal stipends
A fully stocked kitchen
$300 toward your custom desk setup
Pre-tax commuter benefits
401(k) retirement plan
Monthly office activities
Frequent optional team happy hours
Company
Basis
Basis provides AI agents that automate accounting workflows for professionals.
Founded in 2023
11-50 employees
H1B Sponsorship
Basis has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (2)
2022 (5)
2020 (1)
Funding
Current Stage
Early StageTotal Funding
$37.6MKey Investors
Khosla VenturesBetter Tomorrow Ventures
2024-12-17Series A· $34M
2023-10-18Seed· $3.6M
2023-03-20Pre Seed
Leadership Team
Matt Harpe
Co-Founder
Mitchell Troyanovsky
Co-Founder
Recent News
2025-08-15
Company data provided by crunchbase