Member of Technical Staff - Edge Inference Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Liquid AI · 5 hours ago

Member of Technical Staff - Edge Inference Engineer

Liquid AI, spun out of MIT CSAIL, builds general-purpose AI systems that run efficiently across various deployment targets. The Edge Inference Engineer will work on optimizing machine code for resource-constrained devices, collaborating with the technical lead to enhance model performance on real devices.

Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
check
H1B Sponsor Likelynote

Responsibilities

Implement and optimize inference kernels for CPU, NPU, and GPU architectures across diverse edge hardware
Develop quantization strategies (INT4, INT8, FP8) that maximize compression while preserving model quality under strict memory budgets
Contribute to llama.cpp and other open-source inference frameworks, including new model architectures (audio, vision)
Profile and optimize end-to-end inference pipelines to achieve sub-100ms time-to-first-token on target devices
Collaborate with ML researchers to understand model architectures and identify optimization opportunities specific to Liquid Foundation Models

Qualification

C++Embedded software engineeringMachine learning fundamentalsHardware architecture conceptsQuantization strategiesContributions to llama.cppRustCustom accelerator developmentQuantitative degree

Required

5+ years of experience in systems programming with strong C++ proficiency
Embedded software engineering experience or work on resource-constrained systems
Understanding of ML fundamentals at the linear algebra level (how matrix operations, attention, and quantization work)
Experience with hardware architecture concepts: cache hierarchies, memory bandwidth, SIMD/vectorization

Preferred

Contributions to llama.cpp, ExecuTorch, or similar inference frameworks
Experience with Rust for systems programming
Background in custom accelerator development (TPU, NPU) or work at companies like SambaNova, Cerebras, Groq, or Google/Amazon accelerator teams
Quantitative degree (mathematics, physics, or similar) combined with engineering experience

Benefits

We pay 100% of medical, dental, and vision premiums for employees and dependents
401(k) matching up to 4% of base pay
Unlimited PTO plus company-wide Refill Days throughout the year

Company

Liquid AI

twittertwittertwitter
company-logo
Build efficient general-purpose AI at every scale.

H1B Sponsorship

Liquid AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)

Funding

Current Stage
Growth Stage
Total Funding
$293.1M
Key Investors
AMD VenturesOSS Capital L.P.
2024-12-13Series A· $250M
2023-12-01Seed· $37.5M
2023-05-05Seed· $5.6M

Leadership Team

leader-logo
Ramin Hasani
Co-founder and CEO
linkedin
leader-logo
Mathias Lechner
Co-founder and CTO
Company data provided by crunchbase