AI QA - Engineer / Technical Staff jobs in United States
cer-icon
Apply on Employer Site
company-logo

Lenovo · 23 hours ago

AI QA - Engineer / Technical Staff

positionChicago, IL
timeFull-time
remoteHybrid
seniorityMid, Senior Level
money$110K/yr - $150K/yr
date3+ years exp

Lenovo is a global technology powerhouse focused on delivering Smarter Technology for All. As an AI QA Engineer, you will work with a collaborative team to ensure AI systems are accurate, safe, and reliable, implementing test frameworks and monitoring performance for AI/ML systems.

ComputerConsumer ElectronicsElectronicsHardwareMobileWearables
check
H1B Sponsor Likelynote

Responsibilities

Design and implement comprehensive test frameworks for AI/ML systems: LLMs, vision models, RAG pipelines, agentic workflows
Build automated evaluation systems for model outputs—accuracy, relevance, bias detection, hallucination monitoring
Create quality benchmarks and continuous testing pipelines for generative AI (content quality, safety, brand alignment)
Develop performance monitoring infrastructure: model drift detection, data quality validation, inference latency tracking
Establish AI-specific quality gates and work with product/engineering teams in Agile sprints to define acceptance criteria
Stay ahead of AI testing trends: adversarial testing, red-teaming, AI safety evaluation

Qualification

QA/test engineeringML model evaluationTest automation frameworksAI risks knowledgePassion for AI qualityCollaboration skills

Required

3+ years in QA/test engineering, with focus on AI/ML systems
Deep understanding of ML model evaluation: classification metrics, NLP evaluation (BLEU, ROUGE, human eval), vision model testing
Experience building test automation frameworks (Python, pytest, CI/CD pipelines)

Preferred

Knowledge of AI risks: bias, fairness, safety, hallucinations, adversarial attacks
Strong collaboration skills—comfortable working with data scientists, ML engineers, and product managers
Passion for AI quality and keeping current with testing methodologies for generative AI

Company

Lenovo

twittertwittertwitter
Glassdoor3.9
company-logo
Lenovo Group is a computer technology company that manufactures personal computers, smartphones, televisions, and wearable devices.
dateFounded in 1984
location
Beijing, Beijing, CHN
people-size10001+ employees
web-link
https://www.lenovo.com/in/en/

H1B Sponsorship

Lenovo has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (76)
2024 (52)
2023 (75)
2022 (82)
2021 (58)
2020 (67)

Funding

Current Stage
Public Company
Total Funding
$3.35B
Key Investors
Alat
2025-01-08Post Ipo Debt· $2B
2024-04-01Post Ipo Debt· $500M
2017-10-03Post Ipo Equity· $500M

Leadership Team

leader-logo
Yang Yuanqing
Chairman & CEO
linkedin
leader-logo
Greg Huff
CTO, CSO, and SVP of Development, Quality, and Customer Care, Infrastructure Solutions Group
linkedin

Recent News

The Express Tribune
AI pendants, brooches make strong fashion comeback
2026-01-12
36kr.com
Looking back at CES 2026, several core trends need to be grasped.
2026-01-12
Techlicious Latest Articles
Lenovo's All-in-One PC Brings an Immersive Experience to the Desktop
2026-01-11
Company data provided by crunchbase