Software Engineer Intern (ML System) - 2026 Start (PhD) jobs in United States
cer-icon
Apply on Employer Site
company-logo

ByteDance · 2 weeks ago

Software Engineer Intern (ML System) - 2026 Start (PhD)

positionUnited States
timeInternship
remoteRemote
seniorityIntern
money$60/hr - $60/hr
workcardStart in 2026

ByteDance is a company that inspires creativity and enriches life through innovative products. The Software Engineer Intern will work on developing and maintaining large-scale machine learning training and inference systems, focusing on architecture design and optimization.

ContentData MiningFoundational AIInternetSocial Media
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-scale online systems
Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability
Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable continuous delivery
Collaborating closely with the MLE for optimization of algorithms and systems
Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as well as possessing strong team communication and collaboration skills

Qualification

C/C++PythonOnline architectureGPU architectureLLM modelsCommunication skillsSelf-motivationLearning abilityTeam collaboration

Required

Excellent coding skills, strong understanding of data structures, and fundamental knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc
Rich experience in online architecture, with the ability to troubleshoot independently
Strong sense of responsibility, good learning ability, communication skills, and self-motivation

Preferred

Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis
Knowledge of LLM models, experience in accelerating LLM model optimization is preferred

Benefits

Day one access to health insurance
Life insurance
Wellbeing benefits
10 paid holidays per year
Paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year)
Housing allowance

Company

ByteDance

twittertwittertwitter
Glassdoor3.8
company-logo
ByteDance is a technology company that develops content creation platforms and services.
dateFounded in 2012
location
Beijing, Beijing, CHN
people-size10001+ employees
web-link
http://bytedance.com

H1B Sponsorship

ByteDance has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)

Funding

Current Stage
Late Stage
Total Funding
$9.8B
Key Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M

Leadership Team

leader-logo
Jochen Bischoff
Head of Global Business Solutions - Africa
linkedin
leader-logo
Matty Lin
General Manager, Global Business Solutions, KR
linkedin

Recent News

36kr.com
ByteDance is valued at $350 billion, and HSG's new fund raises capital to acquire shares.
2026-01-08
DealStreetAsia
HSG's continuation fund to value ByteDance at up to $370b: report
2026-01-08
Investing.com
US appeals court appears skeptical of Meta, social media companies’ bid to cut off addiction lawsuits
2026-01-07
Company data provided by crunchbase