CVS Health · 2 days ago
Conversational AI QA Engineering Lead Director
CVS Health is dedicated to building a world of health around every individual, and they are seeking a Conversational AI QA Engineering Lead Director to guide high-performing QA teams focused on conversational AI solutions. The role involves leading QA strategies, ensuring high-quality delivery of voice and chatbot products, and fostering a culture of excellence within the team.
RetailHealthcarePharmaceuticalHealth CareMedicalSales
Responsibilities
Lead enterprise QA strategy for Conversational AI platforms, ensuring high‑quality, scalable delivery of voice and chatbot solutions aligned with business objectives and customer experience goals
Own end‑to‑end quality assurance execution across AI model validation, automation, and manual testing, driving consistent quality outcomes and timely release cycles
Build, develop, and inspire high‑performing QA teams, including QA engineers and test managers, fostering a culture of excellence, collaboration, and continuous improvement
Establish and evolve QA frameworks, governance, and KPIs to ensure performance, compliance, risk management, and measurable ROI for conversational AI initiatives
Champion modern QA practices and emerging technologies, including agile testing methodologies, automation frameworks, and AI‑specific QA tools
Partner closely with product, engineering, and leadership teams to identify quality risks, communicate insights and metrics, and proactively improve customer experience
Qualification
Required
10+ years of experience in QA leadership roles, with at least 5 years focused on cloud-native environments (IBM & Azure highly preferred) testing conversational AI solutions, including voice and chatbots
10+ years of experience translating complex QA strategies into strategic business outcomes
10+ years of experience with QA automation and scripting using languages such as Java, Python, or Node.js
7+ years of experience as a QA lead for large-scale AI or digital transformation programs working in a high-performance Agile environment
Strong understanding of conversational AI technologies (e.g., chatbots, voice assistants, LLMs, STT/TTS, NLU/NLP engines) and QA techniques for validating these technologies, including model testing, regression, and performance validation
Bachelor's degree or equivalent experience (HS diploma + 4 years relevant QA experience)
Preferred
Executive-level communication skills, capable of effectively articulating QA and strategic concepts to multiple stakeholders
Experience with IBM WatsonX and its suite of AI tools and services
Advanced degree (Master's or PhD) in Computer Science, Engineering, AI, or a related field
Hands-on experience with Large Language Models (LLM) and their practical applications in conversational AI QA
Familiarity with SAFE agile methodologies and experience in leading agile QA teams
7+ years of experience with API testing tools such as Postman, Swagger, or similar tools
Benefits
Affordable medical plan options, a 401(k) plan (including matching company contributions), and an employee stock purchase plan.
No-cost programs for all colleagues including wellness screenings, tobacco cessation and weight management programs, confidential counseling and financial coaching.
Benefit solutions that address the different needs and preferences of our colleagues including paid time off, flexible work schedules, family leave, dependent care resources, colleague assistance programs, tuition assistance, retiree medical access and many other benefits depending on eligibility.
Company
CVS Health
CVS Health is a health solutions company that provides an integrated healthcare services to its members.
H1B Sponsorship
CVS Health has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2022 (1)
Funding
Current Stage
Public CompanyTotal Funding
$4BKey Investors
Michigan Economic Development CorporationStarboard Value
2025-08-15Post Ipo Debt· $4B
2025-07-17Grant· $1.5M
2019-11-25Post Ipo Equity
Leadership Team
Recent News
Hartford Business Journal
2026-02-12
Springfield Business Journal
2026-02-11
Company data provided by crunchbase