AI/ML Software QA Lead jobs in United States
info-icon
This job has closed.
company-logo

Nesco Resource ยท 1 month ago

AI/ML Software QA Lead

Nesco Resource is a company seeking a Quality Assurance Manager who oversees full end-to-end testing for enterprise applications, data-driven systems, and AI-enabled solutions. The role involves leading a team of analysts and engineers, ensuring detailed test planning, execution, and defect resolution throughout the software lifecycle.

ConsultingHuman ResourcesStaffing Agency

Responsibilities

Lead, mentor, and grow a QA team with a focus on AI/ML testing
Build and execute test plans for AI models, data pipelines, and application features
Oversee manual and automated testing across multiple projects and integrated systems
Partner with engineering, product, and data science to define acceptance criteria and test strategies
Support deployments across Dev, QA, and Production environments
Maintain test environments, test data, and required infrastructure
Identify and mitigate quality risks, including AI-specific risks such as bias, data leakage, and adversarial threats
Track QA metrics (coverage, defect leakage, RAG status) and report to stakeholders
Drive continuous improvement in QA processes, automation, and tooling
Ensure compliance with ethical AI standards, data privacy requirements, and regulatory expectations
Collaborate with automation teams to enhance automated test suites
Support production validation and provide user support when needed

Qualification

QA leadershipAI/ML testingAutomation frameworksAdvanced SQLQA methodologiesMLOps practicesAzure DevOpsSeleniumMLflowMS Office SuiteCommunication skillsDetail-orientedCollaboration

Required

5+ years of QA leadership experience within software, data, or AI/ML environments
Strong understanding of AI/ML testing concepts (model evaluation, fairness/bias, supervised/unsupervised learning)
Hands-on experience with automation frameworks and scripting
Advanced SQL skills and comfort validating data workflows
Proficiency with QA methodologies, SDLC processes, and MLOps practices
Experience coordinating offshore/nearshore development or testing teams
Excellent communication, documentation, and stakeholder engagement skills
Highly organized, detail-oriented, and effective in fast-paced environments

Preferred

ALM/QA Tools: Azure DevOps, TFS, MTM, HPQC or similar
Automation: Selenium, UiPath, comparable frameworks
ML/AI Testing: MLflow, TFX, PyCaret, pytest
Cloud/Automation: Azure AI services, Power Automate
Collaboration: SharePoint
General: MS Office Suite

Benefits

MEC (Minimum Essential Coverage) plan that encompasses Medical, Vision, Dental, 401K, and EAP (Employee Assistance Program) services.

Company

Nesco Resource

company-logo
Nesco Resource s an Staffing and Recruiting firm.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Michael McDonald
Executive Vice President of Finance and Chief Accounting Officer
linkedin

Recent News

Company data provided by crunchbase