Senior Engineering Manager, Model Inference & Serving, Machine Learning Platform jobs in United States
cer-icon
Apply on Employer Site
company-logo

Netflix · 1 month ago

Senior Engineering Manager, Model Inference & Serving, Machine Learning Platform

positionUnited States
timeFull-time
remoteRemote
seniorityDirector/Executive
money$190K/yr - $1,195K/yr
date10+ years exp

Netflix is one of the world's leading entertainment services, with over 300 million paid memberships in over 190 countries. They are seeking a Senior Engineering Manager to lead the Model Inference & Serving pillar within the ML Platform organization, responsible for setting the strategic vision and execution across multiple teams that deliver the core model serving infrastructure for all of Netflix.

Digital EntertainmentMedia and EntertainmentTVVideo Streaming
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Set the vision and strategy for all aspects of model inference and serving at Netflix, ensuring our platform supports the next generation of ML innovation, including LLMs, GenAI, and real-time personalization
Lead and develop a cohort of engineering managers and technical leads responsible for core functions, including model routing, inference systems, experimentation, serving frameworks, and the performance and scalability of model serving at Netflix
Drive cross-team and cross-functional alignment, collaborating with ML researchers, product engineering, infrastructure, and platform partners to maximize business and member impact
Champion operational excellence and continuous improvement, ensuring reliability, scalability, and cost-effectiveness across all model serving systems
Define and communicate the pillar’s multi-year vision, technical strategy, and roadmap
Anticipate future platform and business needs, especially as ML architectures and use cases evolve
Drive the transition from legacy, domain-based serving to a unified, modular, and domain-agnostic serving platform
Manage and mentor engineering managers and technical leads; build a strong leadership bench
Foster a culture of high performance, candor, innovation, and inclusion, aligned with Netflix’s values
Attract, hire, and retain outstanding talent across the pillar
Set and uphold technical standards for reliability, scalability, and performance across all teams
Oversee development of foundational serving infrastructure: real-time/batch inference, frameworks, experimentation, control plane, and tooling
Ensure robust support for diverse model types (deep learning, LLMs, bandits, etc.), hardware targets (CPU/GPU), and SLAs
Own operational health and reliability at scale, including observability, SLOs, and incident response
Build and maintain strong partnerships with ML practitioners, product engineering, infrastructure, and platform teams
Represent the Model Serving pillar to Netflix senior leadership, clearly communicating the vision, progress, and priorities
Influence and drive alignment on platform direction, investment, and priorities

Qualification

ML model servingDistributed systemsHigh-scale productionModern ML frameworksInference enginesStakeholder managementOrganizational changeStrategic thinkingCommunication skills

Required

Proven success managing multiple managers in high-scale ML infrastructure/platform environments
10+ years of technical experience, with 5+ years in engineering management roles
Deep expertise in ML model serving, distributed systems, and high-scale production environments
Strategic thinking with a track record of delivering complex, cross-team initiatives
Excellent communication and stakeholder management skills
Experience driving organizational change and leading through ambiguity

Preferred

Experience with modern ML frameworks (e.g., PyTorch, TensorFlow), inference engines (e.g., Triton, vLLM), and experimentation platforms is a strong plus
MS/PhD in Computer Science, Engineering, or related field, or equivalent experience preferred

Benefits

Flexible, market-driven compensation structure
Salary and stock options

Company

Netflix

twittertwittertwitter
Glassdoor4.1
company-logo
Netflix is an online streaming platform that enables users to watch TV shows and movies.
dateFounded in 1997
location
Los Gatos, California, USA
people-size10001+ employees
web-link
https://www.netflix.com

H1B Sponsorship

Netflix has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (310)
2024 (309)
2023 (191)
2022 (261)
2021 (268)
2020 (225)

Funding

Current Stage
Public Company
Total Funding
$63.91B
Key Investors
Wells FargoTCVGroupe Arnault
2025-12-05Post Ipo Debt· $59B
2024-08-01Post Ipo Debt· $1.8B
2018-05-05Post Ipo Debt· $2.67M

Leadership Team

leader-logo
Gregory Peters
Co-CEO
linkedin
leader-logo
Ted Sarandos
Co-CEO
linkedin

Recent News

Benzinga.com
Warner Bros Chairman Defends Netflix Deal As Superior Over Paramount's Offer Despite Larry Ellison's Guarantee: 'He Didn't Raise The Price'
2026-01-09
BNN Bloomberg
World shares mostly lower after Wall Street’s strong start to the year cools
2026-01-09
Benzinga.com
Netflix's Ted Sarandos Credits Fiction As His Leadership Guide, Says This Is 'Real' Test For Navigating Challenges
2026-01-09
Company data provided by crunchbase