Scale AI · 1 day ago
Tech Lead Manager- MLRE, ML Systems
NYC Metro Area
Full-time
Hybrid
Lead/Staff
$252K/yr - $315K/yrScale AI is a leading provider of training and evaluation data for the ML lifecycle, focusing on building reliable AI systems. They are seeking a Tech Lead Manager for their ML Systems team to optimize and enhance their distributed framework for large language model training, collaborating closely with ML teams and researchers.
AI InfrastructureArtificial Intelligence (AI)Data Collection and LabelingGenerative AIImage RecognitionMachine Learning
Responsibilities
Build, profile and optimize our training and inference framework
Collaborate with ML and research teams to accelerate their research and development, and enable them to develop the next generation of models and data curation
Research and integrate state-of-the-art technologies to optimize our ML system
Qualification
Required
Build, profile and optimize our training and inference framework
Collaborate with ML and research teams to accelerate their research and development, and enable them to develop the next generation of models and data curation
Research and integrate state-of-the-art technologies to optimize our ML system
Strong software engineering skills, proficient in frameworks and tools such as CUDA, Pytorch, transformers, flash attention, etc
Strong written and verbal communication skills to operate in a cross functional team environment
Preferred
Passionate about system optimization
Experience with multi-node LLM training and inference
Experience with developing large-scale distributed ML systems
Experience with post-training methods like RLHF/RLVR and related algorithms like PPO/GRPO etc
Demonstrated expertise in post-training methods and/or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc
Benefits
Comprehensive health, dental and vision coverage
Retirement benefits
A learning and development stipend
Generous PTO
A commuter stipend
Company
Scale AI
Scale’s mission is to develop reliable AI systems for the world’s most important decisions.
Founded in 2016
501-1000 employees
H1B Sponsorship
Scale AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (82)
2024 (54)
2023 (29)
2022 (17)
2021 (10)
2020 (10)
Funding
Current Stage
Late StageTotal Funding
$15.9BKey Investors
MetaAccelTiger Global Management
2025-06-10Corporate Round· $14.3B
2025-06-04Series Unknown
2024-05-21Series F· $1B
Leadership Team
Jason Droege
Interim Chief Executive Officer
Clemens Viernickel
Head of Product
Recent News
2026-01-16
CB Insights
2026-01-09
Crunchbase News
2026-01-07
Company data provided by crunchbase