AI QA - Lead Engineer / Manager jobs in United States
cer-icon
Apply on Employer Site
company-logo

Lenovo · 2 weeks ago

AI QA - Lead Engineer / Manager

positionChicago, IL
timeFull-time
remoteHybrid
senioritySenior Level
money$180K/yr - $220K/yr
date7+ years exp

Lenovo is a global technology powerhouse focused on delivering smarter technology for all. They are seeking an AI QA - Lead Engineer/ Manager to ensure the reliability and fairness of their AI systems while leading the AI Quality Engineering function.

ComputerConsumer ElectronicsElectronicsHardwareMobileWearables
check
H1B Sponsor Likelynote

Responsibilities

Design and implement comprehensive test frameworks for AI/ML systems: LLMs, vision models, RAG pipelines, agentic workflows
Build automated evaluation systems for model outputs—accuracy, relevance, bias detection, hallucination monitoring
Create quality benchmarks and continuous testing pipelines for generative AI (content quality, safety, brand alignment)
Develop performance monitoring infrastructure: model drift detection, data quality validation, inference latency tracking
Establish AI-specific quality gates and work with product/engineering teams in Agile sprints to define acceptance criteria
Lead a team of AI QA engineers and drive best practices for responsible AI development
Stay ahead of AI testing trends: adversarial testing, red-teaming, AI safety evaluation

Qualification

AI/ML systems testingTest automation frameworksML model evaluationPerformance monitoringQuality benchmarksPassion for AI qualityAI risksCollaboration skills

Required

7+ years in QA/test engineering, with 3+ years focused on AI/ML systems
Bachelor's degree in Engineering or Computer Science
Experience with ML model evaluation: classification metrics, NLP evaluation (BLEU, ROUGE, human eval), vision model testing
Experience building test automation frameworks (Python, pytest, CI/CD pipelines)

Preferred

Strong collaboration skills—comfortable working with data scientists, ML engineers, and product managers
Passion for AI quality and keeping current with testing methodologies for generative AI
Knowledge of AI risks: bias, fairness, safety, hallucinations, adversarial attacks

Company

Lenovo

twittertwittertwitter
Glassdoor3.9
company-logo
Lenovo Group is a computer technology company that manufactures personal computers, smartphones, televisions, and wearable devices.
dateFounded in 1984
location
Beijing, Beijing, CHN
people-size10001+ employees
web-link
https://www.lenovo.com/in/en/

H1B Sponsorship

Lenovo has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (76)
2024 (52)
2023 (75)
2022 (82)
2021 (58)
2020 (67)

Funding

Current Stage
Public Company
Total Funding
$3.35B
Key Investors
Alat
2025-01-08Post Ipo Debt· $2B
2024-04-01Post Ipo Debt· $500M
2017-10-03Post Ipo Equity· $500M

Leadership Team

leader-logo
Yang Yuanqing
Chairman & CEO
linkedin
leader-logo
Greg Huff
CTO, CSO, and SVP of Development, Quality, and Customer Care, Infrastructure Solutions Group
linkedin

Recent News

Ars Technica - All content
SteamOS continues its slow spread across the PC gaming landscape
2026-01-09
Hot Hardware
Lenovo Legion Go 2 To Get A SteamOS Upgrade To Take On Steam Deck
2026-01-09
TechWire Asia
Lenovo outlines a hybrid AI approach at CES 2026
2026-01-09
Company data provided by crunchbase