Roku · 3 weeks ago
Lead ML Inference Engineer, Advertising
Austin, Texas
Full-time
Onsite
Lead/Staff
10+ years expRoku is the #1 TV streaming platform in the U.S. and is focused on powering every television in the world. The Lead ML Inference Engineer will architect and lead the development of a state-of-the-art inference platform for advertising, ensuring optimal performance and scalability while mentoring engineers and driving innovation in machine learning.
AdvertisingAdvertising PlatformsConsumer ElectronicsDigital EntertainmentDigital MediaHardwareMedia and EntertainmentSoftwareVideo Streaming
Responsibilities
Lead the design and development of a SOTA Inference platform
Oversee the development of monitoring, observability, and other tooling to ensure system and model performance, reliability, and scalability of online inference services
Identify and resolve system inefficiencies, performance bottlenecks, and reliability issues, ensuring optimized end-to-end performance
Stay at the forefront of advancements in inference frameworks, ML hardware acceleration, and distributed systems, and incorporate innovations where and when they are impactful
Qualification
Required
10+ years of experience in developing and deploying large-scale, distributed systems, with at least 5 years in a leadership or technical lead role
Strong programming skills in high-performance languages
Deep understanding of inference frameworks and ML system deployment
Proven experience optimizing performance for large-scale machine learning systems, including a deep knowledge of SOTA model optimizations, hardware-software co-design, GPU acceleration, and HPC techniques
Excellent communication and collaboration skills
Experience leading teams working on high-throughput, low-latency ML serving systems
Experience collaborating with and leading global, cross-functional teams
Preferred
M.S. or above in CS, ECE, or a related field
Contributions to open-source ML or systems projects
Benefits
Global access to mental health and financial wellness support and resources
Healthcare (medical, dental, and vision)
Life
Accident
Disability
Commuter
Retirement options (401(k)/pension)
Time off work for vacation and other personal reasons
Company
Roku
Roku develops video streaming devices that provide users access to Internet-streamed video or audio services.
1001-5000 employees
H1B Sponsorship
Roku has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (120)
2024 (166)
2023 (81)
2022 (279)
2021 (195)
2020 (107)
Funding
Current Stage
Public CompanyTotal Funding
$212.01MKey Investors
News CorpFidelityGlobespan Capital Partners
2017-09-28IPO
2015-11-09Series H· $45.5M
2015-11-01Secondary Market
Leadership Team
Preston Smalley
VP of Viewer Product
T
Thomas Dodson
Vice President of Platform Operations
Recent News
2026-01-08
Company data provided by crunchbase