ByteDance · 1 week ago
Software Engineer in ML Systems Graduate (AML - Machine Learning Systems) - 2026 Start (BS/MS)
San Jose, CA
Full-time
Hybrid
New Grad, Entry Level
$119K/yr - $187K/yrByteDance is a global tech company known for its innovative products like TikTok. The Software Engineer in ML Systems Graduate role involves developing and maintaining distributed machine learning systems, focusing on architecture design, stability, and optimization in collaboration with a global team.
ContentData MiningFoundational AIInternetSocial Media
Responsibilities
Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems
Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability
Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable continuous delivery
Collaborating closely with the MLE for optimization of algorithms and systems
Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills
Qualification
Required
Bachelor's degree or above, major in computer/electronics/automation/software, etc
Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc
Rich experience in online architecture, with the ability to troubleshoot independently
Strong sense of responsibility, good learning ability, communication skills, and self-motivation
Preferred
Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis
Knowledge of LLM models, experience in accelerating LLM model optimization is preferred
Benefits
Employees have day one access to medical, dental, and vision insurance
A 401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
Founded in 2012
10001+ employees
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Jochen Bischoff
Head of Global Business Solutions - Africa
Matty Lin
General Manager, Global Business Solutions, KR
Recent News
2026-01-08
Company data provided by crunchbase