Applied Scientist, AI Evaluation Platform jobs in United States
info-icon
This job has closed.
company-logo

Apple · 2 days ago

Applied Scientist, AI Evaluation Platform

positionSeattle, WA
timeFull-time
remoteOnsite
seniorityMid, Senior Level
money$140K/yr - $210K/yr

Apple is a company where individual imaginations come together to create innovative products and services. They are seeking an Applied Scientist to lead the design and development of automated benchmarking methodologies for AI-powered tools, collaborating with various teams to establish evaluation frameworks that enhance product quality.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Lead the design and continuous development of automated benchmarking methodologies for AI-powered code assistant tools
Investigate how coding-focused LLM agents behave
Create rigorous evaluation frameworks
Establish scientific standards for assessing the quality and reliability of AI-powered tools
Collaborate with ML and data scientists, software developers, project managers and other teams at Apple to understand requirements and translate them into scalable, reliable, and efficient evaluation frameworks

Qualification

PythonAI/ML modelsEmpirical evaluationSwiftBenchmarkingAnalytical skillsCommunication skillsCollaborative work

Required

Advanced degree (MS or PhD) in Computer Science, Software Engineering, or equivalent research/work experience
Strong research background in empirical evaluation, experimental design, or benchmarking
Strong proficiency in Python
Intermediate proficiency in Swift
Deep familiarity with software engineering workflows and developer tools
Experience working with or evaluating AI/ML models, preferably LLMs or program synthesis systems
Strong analytical and communication skills, including the ability to write clear reports

Preferred

Publications in ML evaluation or related fields
Experience with automated testing frameworks
Experience constructing human-in-the-loop or multi-turn evaluation setups
Prior work on agentic developer tools

Benefits

Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation

Company

Apple

twittertwittertwitter
Glassdoor4.2
company-logo
Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.
dateFounded in 1976
location
Cupertino, California, USA
people-size10001+ employees
web-link
https://www.apple.com

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering

Recent News

Venrock
Venrock Portfolio
2025-12-01
IndiaTimes
Apple TV+ pulls Jessica Chastain’s "The Savant" just days before premiere
2025-09-25
Mac Daily News
Jessica Chastain: I respect Apple’s decision to pause the release of ‘The Savant’ or something
2025-09-25
Company data provided by crunchbase