Apply on Employer Site

Heartland · 3 weeks ago

Lead QA Engineer (Artificial Intelligence)

Alpharetta, Georgia, USA

Full-time

Hybrid

Senior Level

6+ years exp

Heartland is a Global Payments Holding Company that enables seamless money movement for millions. The Lead QA Engineer will be responsible for ensuring the quality and reliability of AI/ML models and systems by developing QA strategies, collaborating with teams, and validating model outputs.

Credit CardsPaymentsTransaction Processing

No H1B

Responsibilities

Develop and implement QA strategies tailored for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures

Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift)

Collaborate with AI engineers, data scientists, and product teams to define success criteria, acceptance standards, and performance metrics

Validate model outputs and system behaviors against business and ethical guidelines

Perform regression, integration, stress, and adversarial testing of AI models and systems

Identify, log, and track bugs and anomalies, ensuring timely resolutions

Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations)

Ensure compliance with internal AI governance standards, responsible AI principles, and regulatory requirements

Contribute to building automated AI testing frameworks, pipelines, and synthetic data generation systems

Document testing procedures, results, and quality assessments clearly and effectively

Qualification

AI/ML testingPythonTest automationMachine learning frameworksCI/CD toolsContainerization technologiesSoftware testing methodologiesAnalytical skillsCommunication skillsCollaboration skills