Lenovo · 2 hours ago
Head of AI Quality Engineering - REMOTE
United States
Full-time
Remote
Director/Executive
$220K/yr - $320K/yr
12+ years expLenovo is a global technology powerhouse focused on delivering Smarter Technology for All. As the Head of AI Quality Engineering, you will lead the quality discipline to ensure reliable and high-confidence AI experiences across millions of devices, developing test strategies and automation frameworks for AI models and agentic behaviors.
ComputerConsumer ElectronicsElectronicsHardwareMobileWearables
Responsibilities
Build and lead the AI Quality Engineering organization, covering functional testing, scenario testing, automation, and regression
Define and execute a comprehensive AI testing strategy across Windows, Android, cloud, and cross-device experiences
Architect the AI automation framework for UI, system interactions, agent flows, and multimodal input/output validation
Own model and agent evaluation pipelines, including accuracy, latency, grounding, hallucination detection, safety checks, and guardrail tests
Build tooling for validating local vs cloud inference paths, RAG reliability, perception models, and agent orchestration flows
Partner with SRE Delivery to define quality gates, release criteria, and gating policies for the release train
Create a unified scenario library across features like Learning Zone, Notion integration, cross-device continuity, Local Agent, and more
Develop a risk-based testing strategy to support parallel prototyping while maintaining high confidence in integration and release
Work closely with Platform, Core Intelligence, Experience, and Cloud teams to identify quality gaps early and enforce quality standards
Lead the cultural shift toward 'testability by design' and raise the quality bar across all engineering teams
Qualification
Required
12+ years of experience in quality engineering, test automation, or AI/ML validation, with at least 5 years leading teams
Strong background in building automation frameworks for complex distributed or cross-device products
Hands-on experience testing AI models, RAG/LLM systems, perception models, or agentic behaviors is a strong plus
Deep experience with UI automation (Windows, Android), API testing, performance validation, and scenario-based testing
Experience working with telemetry, logs, and debugging across large-scale systems
Preferred
Ability to work across geos and manage cross-functional alignment with platform, intelligence, cloud, and experience teams
Proven success driving quality culture in fast-paced engineering organizations
25% global travel ability
Company
Lenovo
Lenovo Group is a computer technology company that manufactures personal computers, smartphones, televisions, and wearable devices.
10001+ employees
H1B Sponsorship
Lenovo has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (76)
2024 (52)
2023 (75)
2022 (82)
2021 (58)
2020 (67)
Funding
Current Stage
Public CompanyTotal Funding
$3.35BKey Investors
Alat
2025-01-08Post Ipo Debt· $2B
2024-04-01Post Ipo Debt· $500M
2017-10-03Post Ipo Equity· $500M
Leadership Team
Yang Yuanqing
Chairman & CEO
Greg Huff
CTO, CSO, and SVP of Development, Quality, and Customer Care, Infrastructure Solutions Group
Recent News
2026-01-25
2026-01-25
Livemint.com
2026-01-24
Company data provided by crunchbase