ML Engineer - Inference Serving jobs in United States
cer-icon
Apply on Employer Site
company-logo

Luma AI · 4 hours ago

ML Engineer - Inference Serving

positionPalo Alto, CA
timeFull-time
remoteHybrid
seniorityMid Level

Luma AI is dedicated to building multimodal AI to enhance human imagination and capabilities. They are seeking an ML Engineer to ship new model architectures, optimize model efficiency, and manage inference workloads across clusters and hardware providers.

Artificial Intelligence (AI)Foundational AIGenerative AIVideoVideo Editing
check
H1B Sponsor Likelynote

Responsibilities

Ship new model architectures by integrating them into our inference engine
Collaborate closely across research, engineering and infrastructure to streamline and optimize model efficiency and deployments
Build internal tooling to measure, profile, and track the lifetime of inference jobs and workflows
Automate, test and maintain our inference services to ensure maximum uptime and reliability
Optimize deployment workflows to scale across thousands of machines
Manage and optimize our inference workloads across different clusters & hardware providers
Build sophisticated scheduling systems to optimally leverage our expensive GPU resources while meeting internal SLOs
Build and maintain CI/CD pipelines for processing/optimizing model checkpoints, platform components, and SDKs for internal teams to integrate into our products/internal tooling

Qualification

PythonModel servingKubernetesDockerLinuxRedisS3-compatible StorageCUDAFFmpegTraffic-controlFleet managementHigh performance ML systemsModern networking stacks

Required

Strong Python and system architecture skills
Experience with model deployment using PyTorch, Huggingface, vLLM, SGLang, tensorRT-LLM, or similar
Experience with queues, scheduling, traffic-control, fleet management at scale
Experience with Linux, Docker, and Kubernetes
Must have Python
Redis
S3-compatible Storage
Model serving (one of: PyTorch, vLLM, SGLang, Huggingface)
Understanding of large-scale orchestration, deployment, scheduling (via Kubernetes or similar)

Preferred

Experience with modern networking stacks, including RDMA (RoCE, Infiniband, NVLink)
Experience with high performance large scale ML systems (>100 GPUs)
Experience with FFmpeg and multimedia processing
CUDA
FFmpeg

Company

Luma AI

twittertwittertwitter
company-logo
Luma AI develops tools that let users generate photorealistic images and videos from text, image, or video prompts.
dateFounded in 2021
location
Palo Alto, California, USA
people-size51-200 employees
web-link
https://lumalabs.ai

H1B Sponsorship

Luma AI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (10)
2024 (3)

Funding

Current Stage
Growth Stage
Total Funding
$1.06B
Key Investors
HUMAINAndreessen HorowitzAmplify Partners
2025-11-19Series C· $900M
2024-12-06Series B· $90M
2024-01-09Series B· $43M

Leadership Team

leader-logo
Amit Jain
Co-Founder
linkedin

Recent News

MarketWatch
As AMD chases Nvidia, here’s how it’s positioning itself for the future of AI
2026-01-09
Morningstar.com
As AMD chases Nvidia, here's how it's positioning itself for the future of AI
2026-01-06
Business Wire
Luma AI Announces Ray3 Modify, a New Model for Hybrid-AI Workflows for Acting & Performances, Now Available in Dream Machine
2025-12-18
Company data provided by crunchbase