Apply on Employer Site

TikTok · 2 months ago

Large Model Training Acceleration Engineer

San Jose, CA

Full-time

Onsite

Senior Level

$137K/yr - $360K/yr

5+ years exp

TikTok is the leading destination for short-form mobile video, and they are seeking a Large Model Training Acceleration Engineer to enhance the performance and scalability of large-scale generative AI models. The role involves optimizing training pipelines and developing distributed training strategies to improve efficiency and speed.

Content CreatorsContent DiscoveryMedia and EntertainmentSocial MediaVideo

H1B Sponsor Likely

Responsibilities

Optimize large model training pipelines to improve efficiency, speed, and scalability

Develop and improve distributed training strategies such as data parallelism, model parallelism, pipeline parallelism and communication to accelerate model training

Benchmark and profile deep learning models to identify performance bottlenecks and optimize computational resources

Qualification

AI model training optimizationPythonC++CUDADeep learning frameworksDistributed training techniquesTransformersDiffusion modelsSoftware engineering skillsBenchmarkingProfiling

Required

Master's or PhD in Computer Science, Electrical Engineering, Artificial Intelligence, or a related field

5+ years of experience in AI model training optimization

Strong software engineering skills, including proficiency in Python, C++, and CUDA

Strong proficiency in deep learning frameworks such as PyTorch, Megatron and Deepspeed

Experience with distributed training techniques such as data parallelism, model parallelism, and pipeline parallelism

Knowledge of transformers and diffusion models

Benefits

Employees have day one access to medical, dental, and vision insurance

A 401(k) savings plan with company match

Paid parental leave

Short-term and long-term disability coverage

Life insurance

Wellbeing benefits

10 paid holidays per year

10 paid sick days per year

17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)

Company

TikTok

Glassdoor3.4

TikTok is a short-form video entertainment app and social network platform. It is a sub-organization of ByteDance.

Founded in 2003

Los Angeles, California, USA

10001+ employees

https://www.tiktok.com

H1B Sponsorship

TikTok has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (979)

2024 (601)

2023 (387)

2022 (322)

2021 (133)

2020 (72)