Senior Software Engineer - Efficient ML jobs in United States
cer-icon
Apply on Employer Site
company-logo

ByteDance · 2 months ago

Senior Software Engineer - Efficient ML

ByteDance is a leading technology company known for its innovative products like TikTok. The Senior Software Engineer will be part of the Vision Engineering Team, focusing on developing GenAI technologies to enhance user experience through efficient model training, optimization, and deployment.

ContentData MiningFoundational AIInternetSocial Media
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Develop algorithm acceleration technologies for text-to-image/text-to-video models through knowledge distillation, model architecture redesign (dynamic MoE routing/sparse attention), and parameter-efficient design (low-bit quantization) to achieve order-of-magnitude efficiency gains
Lead generative model innovation with focus on diffusion acceleration (sampling step reduction/latent optimization), autoregression model efficiency
Collaborate cross-functionally to identify performance bottlenecks, optimize vision models via algorithmic breakthroughs, and enhance ByteDance's product capabilities

Qualification

C++PythonDiffusion modelsModel compressionDeep learning frameworksCommunication skillsTeamwork skills

Required

B.S./M.S./Ph.D. in Computer Science or related fields with 5+ years of software development experience
Proficient in C++/Python and high-performance coding
Expertise in diffusion models (Stable Diffusion/DiT) with deep understanding of computational bottlenecks and optimization methodologies
Proven experience in 1 domain: model compression (quantization/knowledge distillation), efficient architectures (MoE/sparse attention), generative alignment (RLHF/DPO)
Excellent communication and teamwork skills, capable of thriving in a fast-paced work environment

Preferred

Kaggle competition achievements, publications at ICML/NeurIPS/CVPR, or open-source contributions (e.g., HuggingFace Diffusers optimization)
Research experience in GenAI /MLsys areas
Familiarity with open source deep learning frameworks such as Pytorch/DeepSpeed/Jax etc

Benefits

Employees have day one access to medical, dental, and vision insurance
A 401(k) savings plan with company match
Paid parental leave
Short-term and long-term disability coverage
Life insurance
Wellbeing benefits
10 paid holidays per year
10 paid sick days per year
17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)

Company

ByteDance

company-logo
ByteDance is a technology company that develops content creation platforms and services.

H1B Sponsorship

ByteDance has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1350)
2024 (1123)
2023 (775)
2022 (487)
2021 (417)
2020 (245)

Funding

Current Stage
Late Stage
Total Funding
$9.8B
Key Investors
Capital TodayG42Tiger Global Management
2025-11-20Secondary Market· $300M
2024-07-25Secondary Market
2023-03-14Secondary Market· $100M

Leadership Team

leader-logo
Jochen Bischoff
Head of Global Business Solutions - Africa
linkedin
leader-logo
Matty Lin
General Manager, Global Business Solutions, KR
linkedin
Company data provided by crunchbase