Apply on Employer Site

Chase · 1 month ago

Executive Director, Head of AI Testing and Monitoring – HR & Employee Experience

1111 Polaris Pkwy, Columbus, OH, 43240, US

Full-time

Onsite

Senior Level, Lead/Staff

10+ years exp

Chase is seeking an Executive Director to lead a new Center of Excellence focused on AI Testing and Monitoring for HR and Employee Experience. This role involves establishing governance frameworks, ensuring model quality, and collaborating with various stakeholders to deliver ethical AI solutions.

BankingFinancial Services

Responsibilities

Establish and lead the AI Testing & Monitoring Center of Excellence for HR and Employee Experience, setting its mission, strategy, and success metrics

Serve as the accountable owner for model quality assurance and ethical compliance across all HR and Employee Experience AI use cases

Align testing standards with firmwide AI risk management and governance frameworks

Design and operationalize a dual-lane testing model for generative and statistical/ML AI solutions

Implement continuous monitoring pipelines and dashboards to detect model drift, data quality issues, and policy violations

Define and maintain standard metrics, SLAs, and certification thresholds for production readiness and operational health

Act as the primary executive interface for external vendors delivering testing capabilities, overseeing vendor performance, budget, and contract management

Ensure vendor alignment with security, privacy, and regulatory standards, and drive innovation through automated testing, synthetic data, and bias mitigation techniques

Partner with HR and Employee Experience product teams to embed testing checkpoints throughout the AI development lifecycle

Collaborate with Compliance, Legal, Model Risk, and Operational Risk teams to ensure traceability, auditability, and regulatory adherence

Deliver regular executive dashboards and readouts to HR leadership and governance committees, and champion a culture of responsible AI by educating stakeholders on best practices and ethical principles

Qualification

AI/ML governanceModel testing managementGenerative AI evaluationStatistical model validationVendor managementAutomated testingSynthetic data generationMLOps familiarityStakeholder managementInnovation in AI governanceProfessional certificationsCommunication skillsPresentation skills

Required

Minimum 10 years of experience in AI/ML governance, data science, or AI product leadership, with at least 5 years in a regulated enterprise environment and Advanced degree in Data Science, Statistics, Computer Science, or related discipline

Proven experience building or managing model testing or validation functions, ideally within financial services, technology, or consulting

Deep understanding of generative AI and large language model evaluation techniques, including prompt variance testing, bias audits, hallucination metrics, and guardrail evaluation

Strong grounding in statistical and predictive model validation, including drift analytics, bias detection, and performance monitoring

Exceptional cross-functional influence and vendor management skills

Demonstrated ability to translate technical risk concepts into business and ethical language for senior executives