AI/ML Software QA Lead jobs in United States
cer-icon
Apply on Employer Site
company-logo

Nesco Resource ยท 1 month ago

AI/ML Software QA Lead

Confidential company is seeking a Quality Assurance Manager to oversee full end-to-end testing for enterprise applications, data-driven systems, and AI-enabled solutions. This position leads a team of analysts and engineers, ensuring detailed test planning, execution, and defect resolution throughout the software lifecycle.

ConsultingHuman ResourcesStaffing Agency

Responsibilities

Lead, mentor, and grow a QA team with a focus on AI/ML testing
Build and execute test plans for AI models, data pipelines, and application features
Oversee manual and automated testing across multiple projects and integrated systems
Partner with engineering, product, and data science to define acceptance criteria and test strategies
Support deployments across Dev, QA, and Production environments
Maintain test environments, test data, and required infrastructure
Identify and mitigate quality risks, including AI-specific risks such as bias, data leakage, and adversarial threats
Track QA metrics (coverage, defect leakage, RAG status) and report to stakeholders
Drive continuous improvement in QA processes, automation, and tooling
Ensure compliance with ethical AI standards, data privacy requirements, and regulatory expectations
Collaborate with automation teams to enhance automated test suites
Support production validation and provide user support when needed

Qualification

QA leadership experienceAI/ML testing conceptsAutomation frameworksAdvanced SQL skillsQA methodologiesMLOps practicesCollaboration toolsCommunicationDetail-orientedFast-paced environment

Required

5+ years of QA leadership experience within software, data, or AI/ML environments
Strong understanding of AI/ML testing concepts (model evaluation, fairness/bias, supervised/unsupervised learning)
Hands-on experience with automation frameworks and scripting
Advanced SQL skills and comfort validating data workflows
Proficiency with QA methodologies, SDLC processes, and MLOps practices
Experience coordinating offshore/nearshore development or testing teams
Excellent communication, documentation, and stakeholder engagement skills
Highly organized, detail-oriented, and effective in fast-paced environments

Preferred

ALM/QA Tools: Azure DevOps, TFS, MTM, HPQC or similar
Automation: Selenium, UiPath, comparable frameworks
ML/AI Testing: MLflow, TFX, PyCaret, pytest
Cloud/Automation: Azure AI services, Power Automate
Collaboration: SharePoint
General: MS Office Suite

Benefits

MEC (Minimum Essential Coverage) plan that encompasses Medical
Vision
Dental
401K
EAP (Employee Assistance Program) services

Company

Nesco Resource

company-logo
Nesco Resource s an Staffing and Recruiting firm.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Michael McDonald
Executive Vice President of Finance and Chief Accounting Officer
linkedin

Recent News

Company data provided by crunchbase