AI Evaluation Engineer, Siri Core Modeling jobs in United States
cer-icon
Apply on Employer Site
company-logo

Apple · 4 months ago

AI Evaluation Engineer, Siri Core Modeling

positionCupertino, California, United States
timeFull-time
remoteOnsite
seniorityMid Level
money$181K/yr - $318K/yr

Apple is seeking talented engineers to join their team and push the boundaries of evaluations for Siri AI Agents. The role involves designing, building, and maintaining auto-evaluators that measure the quality of Siri’s core AI engine, ensuring a world-class user experience.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Design, build, and maintain auto-evaluators that measure the quality of Siri’s core AI engine
Identify and triage issues and implement changes to improve auto-evaluator trustworthiness
Work with both simulators and real devices to ensure high-fidelity evaluation and a superior user experience
Collaborate with scientists and engineers across software and ML teams, contributing to products shipped across our portfolio of devices

Qualification

Data analysisPythonLarge language modelsML model evaluationTesting pipelinesDebuggingCollaborationProblem solving

Required

M.S. degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience
Strong skills in data analysis and statistical methods utilized in a problem solving environment
Passion for debugging, testing, and triaging issues in complex AI + software systems
Proficiency in Python and experience developing production-quality code
Understanding of large language models (LLMs) and awareness of their strengths and limitations

Preferred

Experience with large-scale ML model evaluation, testing pipelines, and triage
Knowledge of data generation, training workflows, or context engineering
Familiarity with real-world deployment challenges for AI/ML products
Knowledge of latest methodologies in LLM evaluations

Benefits

Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation

Company

Apple

twittertwittertwitter
Glassdoor4.2
company-logo
Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.
dateFounded in 1976
location
Cupertino, California, USA
people-size10001+ employees
web-link
https://www.apple.com

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering

Recent News

Venrock
Venrock Portfolio
2025-12-01
IndiaTimes
Apple TV+ pulls Jessica Chastain’s "The Savant" just days before premiere
2025-09-25
Mac Daily News
Jessica Chastain: I respect Apple’s decision to pause the release of ‘The Savant’ or something
2025-09-25
Company data provided by crunchbase