SIGN IN
Conversational AI QA Engineering Lead Director jobs in United States
cer-icon
Apply on Employer Site
company-logo

CVS Health · 2 days ago

Conversational AI QA Engineering Lead Director

CVS Health is dedicated to building a world of health around every individual, and they are seeking a Conversational AI QA Engineering Lead Director to guide high-performing QA teams focused on conversational AI solutions. The role involves leading QA strategies, ensuring high-quality delivery of voice and chatbot products, and fostering a culture of excellence within the team.
RetailHealthcarePharmaceuticalHealth CareMedicalSales
check
H1B Sponsor Likelynote

Responsibilities

Lead enterprise QA strategy for Conversational AI platforms, ensuring high‑quality, scalable delivery of voice and chatbot solutions aligned with business objectives and customer experience goals
Own end‑to‑end quality assurance execution across AI model validation, automation, and manual testing, driving consistent quality outcomes and timely release cycles
Build, develop, and inspire high‑performing QA teams, including QA engineers and test managers, fostering a culture of excellence, collaboration, and continuous improvement
Establish and evolve QA frameworks, governance, and KPIs to ensure performance, compliance, risk management, and measurable ROI for conversational AI initiatives
Champion modern QA practices and emerging technologies, including agile testing methodologies, automation frameworks, and AI‑specific QA tools
Partner closely with product, engineering, and leadership teams to identify quality risks, communicate insights and metrics, and proactively improve customer experience

Qualification

QA leadershipConversational AI technologiesQA automationAgile methodologiesCloud-native environmentsAPI testing toolsLarge Language ModelsExecutive communicationTeam buildingContinuous improvement

Required

10+ years of experience in QA leadership roles, with at least 5 years focused on cloud-native environments (IBM & Azure highly preferred) testing conversational AI solutions, including voice and chatbots
10+ years of experience translating complex QA strategies into strategic business outcomes
10+ years of experience with QA automation and scripting using languages such as Java, Python, or Node.js
7+ years of experience as a QA lead for large-scale AI or digital transformation programs working in a high-performance Agile environment
Strong understanding of conversational AI technologies (e.g., chatbots, voice assistants, LLMs, STT/TTS, NLU/NLP engines) and QA techniques for validating these technologies, including model testing, regression, and performance validation
Bachelor's degree or equivalent experience (HS diploma + 4 years relevant QA experience)

Preferred

Executive-level communication skills, capable of effectively articulating QA and strategic concepts to multiple stakeholders
Experience with IBM WatsonX and its suite of AI tools and services
Advanced degree (Master's or PhD) in Computer Science, Engineering, AI, or a related field
Hands-on experience with Large Language Models (LLM) and their practical applications in conversational AI QA
Familiarity with SAFE agile methodologies and experience in leading agile QA teams
7+ years of experience with API testing tools such as Postman, Swagger, or similar tools

Benefits

Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan.
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching.
Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.

Company

CVS Health

company-logo
CVS Health is a health solutions company that provides an integrated healthcare services to its members.

H1B Sponsorship

CVS Health has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (1)

Funding

Current Stage
Public Company
Total Funding
$4B
Key Investors
Michigan Economic Development CorporationStarboard Value
2025-08-15Post Ipo Debt· $4B
2025-07-17Grant· $1.5M
2019-11-25Post Ipo Equity

Leadership Team

leader-logo
David Joyner
President and Chief Executive Officer, CVS Health
linkedin
leader-logo
Chandra McMahon
SVP & CISO
linkedin
Company data provided by crunchbase