Marble · 3 months ago
Software Engineer, AI/ML (San Francisco)
San Francisco, CA
Full-time
Hybrid
Mid, Senior LevelMarble Tax is building an AI-powered tax assistant and preparation platform that transforms how accounting firms and their clients handle tax season. We’re looking for a multi-faceted AI/ML-focused engineer who will design and build core AI-driven systems and lead the development of traditional ML components to enhance decision-making in our workflows.
Computer Software
Responsibilities
Design and build core AI-driven systems, including LLM-based retrieval-augmented generation (RAG) pipelines, agent orchestration, and prompt engineering frameworks
Lead development of classifiers, validators, re-rankers, and other traditional ML components to improve accuracy, reduce errors, and enhance decision-making in our assistant workflows
Build robust document parsing and information extraction pipelines capable of handling complex, unstructured tax-related documents and updating workflows retroactively as new data arrives
Collaborate tightly with product, engineering and leadership to quickly test, validate, and improve AI-driven features based on user feedback
Mentor peers, contribute to hiring decisions, and help establish best practices for AI/ML development, evaluation, and deployment
Balance research with production, delivering reliable, secure, and maintainable systems while staying informed on emerging AI/ML developments
Qualification
Required
Proven experience building and deploying AI/ML systems in production, ideally in a product-focused or startup environment
Strong technical foundation in applied ML and software engineering
Deep understanding of LLMs, RAG systems, and agent frameworks, with experience optimizing for latency, accuracy, and cost
Experience with traditional ML techniques, including text classification, ranking, entity extraction, and anomaly detection
Ability to work with unstructured data, build scalable parsing pipelines, and integrate multiple data sources into coherent workflows
Comfort with ambiguity and wearing multiple hats: engineer, researcher, product collaborator, and mentor
Excellent communication skills and a collaborative approach to problem-solving
Comfortable being in person 3 days a week in a highly interactive environment
Preferred
Experience with AI evaluation frameworks, fine-tuning LLMs, or building custom embeddings
Background in accounting, tax software, or enterprise SaaS
Prior experience growing and leading AI/ML teams
Benefits
Competitive compensation
Equity
Benefits
Company
Marble
Marble builds AI tools for accounting firms - our first product Marble Intelligence provides citation-backed tax research, memo drafting and workflow automation.
Founded in 2025
11-50 employees
H1B Sponsorship
Marble has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (3)
2022 (2)
2021 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase