ByteDance · 1 week ago
Software Engineer in ML Systems Graduate (AML - Machine Learning Systems) - 2026 Start (BS/MS)
United States
Full-time
Remote
New Grad, Entry Level
$113K/yr - $178K/yrByteDance is a company dedicated to pioneering advanced AI foundation models. The Software Engineer in ML Systems role focuses on researching and developing machine learning systems, managing cross-layer optimization, and improving efficiency for large-scale distributed training jobs.
ContentData MiningFoundational AIInternetSocial Media
Responsibilities
Research and develop our machine learning systems, including heterogeneous computing architecture, management, and monitoring
Deploy machine learning systems, distributed task scheduling, machine learning training
Manage cross-layer optimization of system and AI algorithms and hardware for machine learning (GPU, ASIC)
Implement both general purpose training framework features and model specific optimizations (e.g. LLM, diffusions)
Improve efficiency and stability for extremely large scale distributed training jobs
Qualification
Required
Master distributed, parallel computing principles; know the recent advances in computing, storage, networking, and hardware technologies
Familiar with machine learning algorithms, platforms and frameworks such as PyTorch and Jax
Have basic understanding of how GPU and/or ASIC works
Expert in at least one or two programming languages in Linux environment: C/C++, CUDA, Python
Preferred
GPU based high performance computing, RDMA high performance network (MPI, NCCL, ibverbs)
Distributed training framework optimizations such as DeepSpeed, FSDP, Megatron, GSPMD
AI compiler stacks such as torch.fx, XLA and MLIR
Large scale data processing and parallel computing
Experiences in designing and operating large scale systems in cloud computing or machine learning
Experiences in in-depth CUDA programming and performance tuning (cutlass, triton)
Benefits
Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
Company
ByteDance
ByteDance is a technology company that develops content creation platforms and services.
Founded in 2012
10001+ employees
H1B Sponsorship
ByteDance has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)
Funding
Current Stage
Late StageTotal Funding
$9.8BKey Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M
Leadership Team
Jochen Bischoff
Head of Global Business Solutions - Africa
Matty Lin
General Manager, Global Business Solutions, KR
Recent News
2026-01-08
Company data provided by crunchbase