On-Device ML Infrastructure Engineer (CoreML Runtime) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Apple · 15 hours ago

On-Device ML Infrastructure Engineer (CoreML Runtime)

Apple is at the forefront of AI and machine learning innovation, specifically through their On-Device Machine Learning team. They are seeking an ML Infrastructure Engineer to build advanced ML graph compilation and runtime systems for efficient execution of ML models on Apple products and services.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Architect and maintain the on-device graph compiler, runtime, and kernels for delivering ML operators
Develop production-critical system software for implementing ML models on Apple Silicon
Proactively identify and resolve functionality gaps
Optimize model execution for various system objectives like performance, energy efficiency, and thermal management

Qualification

C++SwiftCompiler stack experienceMachine Learning fundamentalsPythonOn-device ML stackML authoring frameworkGPU programmingOperating Systems familiarityEmbedding programmingParallel programmingCommunication skills

Required

Masters or equivalent experience in Computer Sciences, Engineering, or related subject area
Highly proficient in C++ or Swift. Familiarity with Python
Experience with any compiler stack (MLIR/LLVM/TVM/...)
Familiarity with Operating Systems, embedding programming, parallel programming
Sound understanding of ML fundamentals, including common architectures such as Transformers
Good communication skills, including ability to communicate with multi-functional audiences

Preferred

Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc
Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.) is a strong plus
Experience with accelerators, GPU programming is a strong plus

Benefits

Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation

Company

Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering
Company data provided by crunchbase