Software Engineer, ML System Architecture jobs in United States
cer-icon
Apply on Employer Site
company-logo

ByteDance · 3 weeks ago

Software Engineer, ML System Architecture

ByteDance is dedicated to pioneering advanced AI foundation models. The role involves designing and developing machine learning infrastructure for large-scale systems, solving technical problems related to system stability and availability, and coordinating multiple teams for system construction.

ContentData MiningFoundational AIInternetSocial Media
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Responsible for the design and development of Machine Learning infrastructure for LLM/AIGC, etc
Build up a super large machine learning system integrating GPUs, RDMA networking, and high-performance storage
Responsible for solving technical problems such as high stability and availability of the system
Organize and coordinate multiple teams to complete the construction of the system, including Data center team, network team, computing team, storage team, resource team

Qualification

Machine Learning infrastructureDistributed systems designKubernetes architectureC++/Go/Python/ShellHigh Performance ComputingLogical analysisSelf-driveCommunication skillsLearning ability

Required

Be proficient in 1 to 2 programming languages such as C++/Go/Python/Shell in Linux environment
Understand the principles of distributed systems and have experience in design, development and maintenance of large-scale machine learning systems
Be familiar with Kubernetes architecture, and have rich experience in system-level development and tuning
Have an excellent logical analysis ability, able to reasonably abstract and split business logic
Have a strong sense of responsibility, good learning ability, communication skills and self-drive

Preferred

Familiar with the ML Infrastructure of Large Model training and inference
Experience in one of the following fields: AI Infrastructure, HW/SW Co-Design, High Performance Computing, ML Hardware Architecture (GPU, Accelerators, Networking)

Benefits

Medical, dental, and vision insurance
401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)

Company

ByteDance

company-logo
ByteDance is a technology company that develops content creation platforms and services.

H1B Sponsorship

ByteDance has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)

Funding

Current Stage
Late Stage
Total Funding
$9.8B
Key Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M

Leadership Team

leader-logo
Jochen Bischoff
Head of Global Business Solutions - Africa
linkedin
leader-logo
Matty Lin
General Manager, Global Business Solutions, KR
linkedin
Company data provided by crunchbase