Apply on Employer Site

Canvas Medical · 4 months ago

Applied AI Operations Lead

San Francisco, CA

Full-time

Onsite

Senior Level

$175K/yr - $250K/yr

5+ years exp

Canvas Medical is accelerating everyday medicine with an EMR platform built for healthcare automation. They are seeking an Applied AI Operations Lead to drive successful deployment, adoption, and governance of AI agents across their customer base, serving as a bridge between engineering and healthcare organizations.

Electronic Health Record (EHR)Health CareMedicalPrimary and Urgent CareWellness

Responsibilities

Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation

Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI

Configure and optimize agent performance using prompt engineering, context management, and tool selection based on specific customer requirements

Create and maintain customer-specific evaluation frameworks that demonstrate agent effectiveness and build stakeholder confidence

Maintain AI governance frameworks that ensure safe, reliable agent operations in production healthcare environments

Design and implement monitoring systems for agent performance, including accuracy tracking, drift detection, and quality assurance protocols

Partner with clinical and compliance teams to ensure deployed agents meet regulatory requirements and operational standards

Develop and deliver training programs that enable care teams to effectively collaborate with AI agents

Work hands-on with foundation model APIs (OpenAI, Claude, Gemini) and the Canvas SDK to troubleshoot and optimize agent behavior

Collaborate with Applied AI engineering to translate field insights into product improvements and new capabilitiesBuild and maintain a library of best practices, implementation templates, and governance playbooks that accelerate customer success

Stay current with advances in LLM technology and healthcare AI applications to guide strategic customer conversations

Serve as the trusted AI advisor for Canvas customers, helping them navigate the transformation to AI-powered healthcare operations

Drive executive conversations about AI strategy, demonstrating how Canvas's platform capabilities enable competitive advantage

Create compelling narratives around AI impact using customer success stories, performance metrics, and ROI analyses

Partner with sales teams on strategic opportunities, providing technical expertise and vision for AI transformation

Qualification

LLM-based applicationsAI governance frameworksFoundation model APIsHealthcare technology experienceProject managementCustomer success engineeringTechnical consultingAnalytical abilitiesCommunication skillsProblem-solving

Required

5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering)

Demonstrated experience deploying and managing LLM-based applications in production environments

Track record of driving successful enterprise technology implementations with measurable business outcomes

Strong project management skills with ability to juggle multiple customer engagements simultaneously

Hands-on experience with products offered from foundation model providers (OpenAI, Anthropic, Google) and AI tools for low-code automation, with understanding of their capabilities and limitations

Understanding of AI safety, alignment, and governance principles

Experience with evaluation frameworks, A/B testing, and performance monitoring for AI systems

Learned experience with the edges and limitations of AI products, and understanding of the iterative process required to get high quality results

Healthcare technology experience required, with ability to give workflow advice and construct automations that meet the needs of healthcare users

Understanding of clinical workflows, EMR systems, and healthcare operations a plus

Familiarity with HIPAA, clinical documentation standards, and healthcare compliance considerations

Ability to quickly develop domain expertise and speak credibly with clinical stakeholders

Comfort with ambiguity and ability to define structure in undefined spaces

Exceptional written and verbal communication skills with ability to create compelling technical content

Strong analytical and problem-solving abilities with data-driven approach to decision making

Experience creating and delivering technical training to diverse audiences

5+ years of experience implementing workflow tools and automation solutions in enterprise settings, with 2+ years of hands-on experience with LLM-based systems

You're deeply familiar with foundation model capabilities and have practical experience with context engineering and adversarial testing

You're able to translate technical complexity into business value, comfortable presenting to both technical teams and C-suite executives

You bring a consultative approach to customer engagement, able to diagnose problems, design solutions, and drive change management

You have experience in healthcare technology or a strong willingness to rapidly develop domain expertise in clinical and operational workflows

You combine technical depth with exceptional communication skills, able to create documentation, deliver training, and influence stakeholders