ByteDance · 15 hours ago
Senior Research Scientist - Machine Learning System
San Jose, CA
Full-time
Onsite
Senior Level
$137K/yr - $360K/yrByteDance is a tech company founded in 2012, known for its innovative products like TikTok. The Senior Research Scientist will be responsible for developing and optimizing LLM inference frameworks and enhancing GPU performance to create a high-performance LLM inference engine.
ContentData MiningFoundational AIInternetSocial Media
Responsibilities
Responsible for developing and optimizing LLM inference framework
Responsible for GPU and CUDA Performance optimization to create an industry-leading high-performance LLM inference engine
Qualification
Required
Bachelor's degree or above, major in computer/electronics/automation/software, etc
Proficient in C/C++, proficient in algorithms and data structures, familiar with Python
Understand the basic principles of deep learning algorithms, be familiar with the basic architecture of neural networks and understand deep learning training frameworks such as Pytorch
Preferred
Proficient in GPU high-performance computing optimization technology on CUDA, in-depth understanding of computer architecture, familiar with parallel computing optimization, memory access optimization, low-bit computing, etc
Familiar with TensorRT-LLM, ORCA, VLLM, etc
Knowledge of LLM models, experience in accelerating LLM model optimization is preferred
Benefits
Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
Founded in 2012
10001+ employees
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Jochen Bischoff
Head of Global Business Solutions - Africa
Matty Lin
General Manager, Global Business Solutions, KR
Recent News
Future Startup
2026-01-14
2026-01-13
Company data provided by crunchbase