Member of Technical Staff - Edge Inference Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Liquid AI · 1 day ago

Member of Technical Staff - Edge Inference Engineer

Liquid AI is a foundation model company spun out of MIT, dedicated to building efficient AI systems at every scale. The Edge Inference Engineer will optimize inference stacks for various edge devices and work closely with the ML team to ensure high-performance model execution.

Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
check
H1B Sponsor Likelynote

Responsibilities

Optimize inference stacks tailored to each platform as we prepare to deploy our models across various edge device types, including CPUs, embedded GPUs, and NPUs
Take our models, dive deep into the task, and return with a highly optimized inference stack, leveraging existing frameworks like llama.cpp, Executorch, and TensorRT to deliver exceptional throughput and low latency

Qualification

Edge inference stacksCPUNPUGPU architecturesPythonPyTorchC++RustHardware architectureSelf-guidedMobile developmentCache-aware algorithmsOwnership

Required

You are a highly skilled engineer with extensive experience in inference on embedded hardware and a deep understanding of CPU, NPU, and GPU architectures
Proficiency in building and enhancing edge inference stacks is essential
Strong ML Experience: Proficiency in Python and PyTorch to effectively interface with the ML team at a deeply technical level
Hardware Awareness: Must understand modern hardware architecture, including cache hierarchies and memory access patterns, and their impact on performance
Proficient in Coding: Expertise in Python, C++, or Rust for AI-driven real-time embedded systems
Optimization of Low-Level Primitives: Responsible for optimizing core primitives to ensure efficient model execution
Self-Guided and Ownership: Ability to independently take a PyTorch model and inference requirements and deliver a fully optimized edge inference stack with minimal guidance

Preferred

Experience with mobile development and in cache-aware algorithms will be highly valued

Company

Liquid AI

twittertwittertwitter
company-logo
Build efficient general-purpose AI at every scale.

H1B Sponsorship

Liquid AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)

Funding

Current Stage
Growth Stage
Total Funding
$293.1M
Key Investors
AMD VenturesOSS Capital L.P.
2024-12-13Series A· $250M
2023-12-01Seed· $37.5M
2023-05-05Seed· $5.6M

Leadership Team

leader-logo
Ramin Hasani
Co-founder and CEO
linkedin
leader-logo
Mathias Lechner
Co-founder and CTO
Company data provided by crunchbase