Crunchyroll · 1 day ago
Staff Software Engineer, AI Runtime Systems
Los Angeles, CA
Full-time
Onsite
Lead/Staff
$200K/yr - $249K/yr
12+ years expCrunchyroll is a leading platform delivering anime to a global audience. They are seeking a Staff Software Engineer to drive the design and evolution of core platform services, focusing on ML inference runtimes and system scalability.
Subscription ServiceVideo
Responsibilities
Architect, build, and maintain ML inference runtimes for multi-model serving, autoscaling, and GPU/TPU utilization
Optimize inference pipelines and platform services for performance, reliability, and scalability
Lead deployment, operationalization, and maintenance of ML workloads in collaboration with ML and data science teams
Shape and maintain core platform services, including authentication, security, and notifications
Ensure seamless integration with platform infrastructure, CI/CD pipelines, and observability systems
Define scalable system architectures and guide cross-team design alignment
Develop benchmarking, validation, and monitoring tools to measure and maintain system performance
Promote security, compliance, and engineering best practices across platform and ML services
Mentor and influence engineering peers, fostering technical excellence and consistent standards
Qualification
Required
12+ years of backend software engineering experience, with a track record of leading complex projects end-to-end
Hands-on experience building and optimizing AI/ML inference runtimes (e.g., KServe, TorchServe, TensorRT, Triton) and integrating with CI/CD and MLOps pipelines (e.g., SageMaker, Kubeflow, BentoML)
Expertise in JavaScript/TypeScript, with additional experience in Golang or Kotlin
Experience with containers, orchestration (Kubernetes/ECS), cloud platforms (AWS preferred), and distributed systems
Experience with performance profiling, model optimization, GPU acceleration, and designing inference workloads to meet latency/throughput SLAs
Experienced in building scalable APIs (REST/gRPC), caching strategies, and high-performance systems, including relational and NoSQL databases
Familiar with monitoring, observability tools, security, and compliance best practices in production ML/AI services
Proven ability to collaborate with ML/AI teams, bridge research and production, and mentor peers
Strong problem-solving, communication, and engineering best practices, with attention to detail and quality
Bachelor's degree in Computer Science, Engineering, or a related field—or equivalent practical experience
Benefits
Receive a great compensation package including salary plus performance bonus earning potential, paid annually.
Flexible time off policies allow you to take the time you need to be your whole self.
Generous medical, dental, vision, STD, LTD, and life insurance
Health Saving Account HSA program
Health care and dependent care FSA
401(k) plan, with employer match
Employer paid commuter benefit
Support program for new parents
Pet insurance and some of our offices are pet friendly!
Company
Crunchyroll
Crunchyroll is a video service provider for Japanese animated productions and Asian media services. It is a sub-organization of Ellation.
1001-5000 employees
H1B Sponsorship
Crunchyroll has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (23)
2024 (15)
2023 (6)
2022 (8)
Funding
Current Stage
Late StageTotal Funding
$26.8MKey Investors
Otter MediaTV Tokyo
2020-12-09Acquired
2015-11-20Series Unknown· $22M
2010-03-25Series Unknown· $0.75M
Leadership Team
Punnoose Isaac
SVP and Head of Center for Data and Insights
Monique Barash
VP, People & Capabilities
Recent News
Android Headlines
2026-01-06
Company data provided by crunchbase