Apple · 9 hours ago
On-device ML Infrastructure Engineer (Compiler & Runtime)
Apple is at the forefront of an evolution where modern AI meets the elegance of Apple silicon. The On-Device Machine Learning team is seeking an experienced ML Infrastructure Engineer to build the essential infrastructure that enables machine learning at scale on Apple devices, focusing on optimizing and driving ML models efficiently across a wide variety of devices and use cases.
AppsArtificial Intelligence (AI)BroadcastingDigital EntertainmentFoundational AIMedia and EntertainmentMobile DevicesOperating SystemsTVWearables
Responsibilities
Help lead and deliver on critical initiatives for on device machine learning infrastructure
Design, build, and maintain critical machine learning infrastructure that powers Apple’s machine learning features
Collaborate with downstream hardware compilers to best leverage Apple’s machine learning hardware
Collaborate with first and third party users to adopt our infrastructure and apply protocols when they implement machine learning on Apple devices
Ensure our infrastructure can run optimally for a wide range of first and third party machine learning models
Qualification
Required
Bachelors in Computer Science, Engineering, or related subject area and 7+ years of hands on experience
Highly proficient in C++. Familiarity with Python and Swift
Familiarity with Operating Systems and Embedded Programming
Sound understanding of ML fundamentals, including common architectures such as Transformers
Good communication skills, including ability to communicate with multi-functional audiences
Preferred
Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc
Experience with open source machine learning models (Mistral, Phi, Gemma, Huggingface, etc)
Experience with any compiler stack (MLIR/LLVM/TVM/...)
Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.)
Experience with machine learning accelerators and GPU programming
Benefits
Comprehensive medical and dental coverage
Retirement benefits
A range of discounted products and free services
Reimbursement for certain educational expenses — including tuition
Discretionary bonuses or commission payments
Relocation
Company
Apple
Apple is a technology company that designs, manufactures, and markets consumer electronics, personal computers, and software.
H1B Sponsorship
Apple has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6998)
2024 (3766)
2023 (3939)
2022 (4822)
2021 (4060)
2020 (3656)
Funding
Current Stage
Public CompanyTotal Funding
$5.67BKey Investors
Berkshire HathawayMicrosoftSequoia Capital
2025-05-05Post Ipo Debt· $4.5B
2025-01-16Post Ipo Debt· $0.31M
2021-04-30Post Ipo Equity
Leadership Team
Tim Cook
CEO
Craig Federighi
SVP, Software Engineering
Recent News
Venrock
2025-12-01
2025-09-25
Mac Daily News
2025-09-25
Company data provided by crunchbase