Chime · 19 hours ago
Technical Program Manager, AI Evaluation Specialist
United States
Full-time
Remote
Mid, Senior Level
$104K/yr - $144K/yr
3+ years expChime is a financial technology company focused on helping individuals achieve financial progress. They are seeking an AI Evaluation Specialist to oversee the evaluation processes for AI systems, ensuring model accuracy and reliability while collaborating with various teams to enhance operational efficiency.
BankingFinancial ServicesFinTech
Responsibilities
Own the Human-in-the-Loop evaluation process for all AI models supporting Operations
Run recurring sampling and reviews to assess accuracy, consistency, and failure modes
Score, tag, and document cases where AI systems misclassify, hallucinate, skip steps, or generate incomplete outputs
Maintain structured rubrics and guidelines to ensure reviewer alignment and scoring consistency
Conduct deeper investigations into error patterns and root causes
Translate insights into recommendations for model owners and partner teams
Track and report key evaluation metrics such as accuracy, recall, coverage, and error types
Maintain thorough documentation for evaluation procedures, sampling logic, and scoring definitions
Collaborate with cross-functional teams to integrate evaluation findings into dashboards and tuning workflows
Support scaling governance processes and strengthening model-health standards across Operations
Qualification
Required
3–5+ years in QA, evaluation, operational analytics, HITL programs, or model monitoring
Experience reviewing unstructured text and applying rubrics or scorecards
Understanding of how AI supports operations (classification, summarization, categorization, automation)
Ability to identify patterns, edge cases, and failure modes from qualitative and quantitative data
Familiarity with QA frameworks or content-review workflows
Strong attention to detail and high consistency standards
Clear communication and documentation skills
A passion for improving member experience by ensuring AI is safe, fair, and reliable
Preferred
Experience with SQL, Looker, Snowflake (nice to have)
COPC or Lean Six Sigma experience is a plus
Benefits
401k match
Great medical, dental, vision, life, and disability benefits
Generous vacation policy and company-wide Chime Days, bonus company-wide paid days off
1% of your time off to support local community organizations of your choice
Annual wellness stipend to use towards eligible wellness related expenses
Up to 24 weeks of paid parental leave for birthing parents and 12 weeks of paid parental leave for non-birthing parents
Access to Maven, a family planning tool, with $15k lifetime reimbursement for egg freezing, fertility treatments, adoption, and more.
In-person and virtual events to connect with your fellow Chimers—think cooking classes, guided meditations, music festivals, mixology classes, paint nights, etc., and delicious snack boxes, too!
Company
Chime
Chime is a financial technology company that offers mobile banking services.
1001-5000 employees
H1B Sponsorship
Chime has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2020 (2)
Funding
Current Stage
Public CompanyTotal Funding
$2.77BKey Investors
Sequoia Capital Global EquitiesDST GlobalMenlo Ventures
2025-06-12IPO
2025-03-01Debt Financing· $475M
2023-07-28Secondary Market
Leadership Team
Chris Britt
Founder and CEO
Ryan King
Co-Founder
Recent News
Business Wire
2026-01-07
2026-01-03
Company data provided by crunchbase