On-device ML Infrastructure Engineer (Compiler & Runtime) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Apple · 9 hours ago

On-device ML Infrastructure Engineer (Compiler & Runtime)

Apple is at the forefront of an evolution where modern AI meets the elegance of Apple silicon. The On-Device Machine Learning team is seeking an experienced ML Infrastructure Engineer to build the essential infrastructure that enables machine learning at scale on Apple devices, focusing on optimizing and driving ML models efficiently across a wide variety of devices and use cases.

AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Help lead and deliver on critical initiatives for on device machine learning infrastructure
Design, build, and maintain critical machine learning infrastructure that powers Apple’s machine learning features
Collaborate with downstream hardware compilers to best leverage Apple’s machine learning hardware
Collaborate with first and third party users to adopt our infrastructure and apply protocols when they implement machine learning on Apple devices
Ensure our infrastructure can run optimally for a wide range of first and third party machine learning models

Qualification

C++Machine Learning FundamentalsCompiler StackPythonEmbedded ProgrammingML Authoring FrameworksSwiftOperating SystemsMachine Learning AcceleratorsCommunication Skills

Required

Bachelors in Computer Science, Engineering, or related subject area and 7+ years of hands on experience
Highly proficient in C++. Familiarity with Python and Swift
Familiarity with Operating Systems and Embedded Programming
Sound understanding of ML fundamentals, including common architectures such as Transformers
Good communication skills, including ability to communicate with multi-functional audiences

Preferred

Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc
Experience with open source machine learning models (Mistral, Phi, Gemma, Huggingface, etc)
Experience with any compiler stack (MLIR/LLVM/TVM/...)
Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.)
Experience with machine learning accelerators and GPU programming

Benefits

Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation

Company

Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.

H1B Sponsorship

Apple has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)

Funding

Current Stage
Public Company
Total Funding
$5.67B
Key Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity

Leadership Team

leader-logo
Tim Cook
CEO
leader-logo
Craig Federighi
SVP, Software Engineering
Company data provided by crunchbase