Research Scientist / Engineer – Training Infrastructure jobs in United States
cer-icon
Apply on Employer Site
company-logo

IntelliPro · 3 months ago

Research Scientist / Engineer – Training Infrastructure

positionUnited States
timeFull-time
remoteRemote
seniorityMid, Senior Level

IntelliPro is a global leader in talent acquisition and HR solutions, dedicated to building capable systems that can understand and interact with the world. They are seeking a Research Scientist / Engineer to design and optimize distributed training systems for multimodal foundation models using advanced techniques and large GPU clusters.

ConsultingHuman ResourcesRecruitingStaffing Agency
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Design, implement, and optimize efficient distributed training systems for models with thousands of GPUs
Research and implement advanced parallelization techniques (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel)
Build monitoring, visualization, and debugging tools for large-scale training runs
Optimize training stability, convergence, and resource utilization across massive clusters

Qualification

Distributed PyTorch trainingGPU clustersParallelism techniquesLinux systems administrationContainerizationOrchestrationCommunication librariesScripting capabilitiesCloud infrastructure

Required

Extensive experience with distributed PyTorch training and parallelisms in foundation model training
Deep understanding of GPU clusters, networking, and storage systems
Familiarity with communication libraries (NCCL, MPI) and distributed system optimization

Preferred

Strong Linux systems administration and scripting capabilities
Experience managing training runs across >100 GPUs
Experience with containerization, orchestration, and cloud infrastructure

Benefits

Comprehensive benefits package

Company

IntelliPro

twittertwittertwitter
Glassdoor4.0
company-logo
IntelliPro Group Inc. is one of the fastest growing IT services and HR solutions companies in Americas & APAC.
dateFounded in 2009
location
Santa Clara, California, USA
people-size501-1000 employees
web-link
https://www.intelliprogroup.com/

H1B Sponsorship

IntelliPro has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (16)
2024 (21)
2023 (33)
2022 (28)
2021 (34)
2020 (36)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Yisu Jin
Founder & CEO
linkedin

Recent News

Medium
IntelliPro Group — Offers Comprehensive It and Hr Services
2024-05-21
Built In San Francisco
ESS Project Manager Engineer - IntelliPro Group Inc.
2024-04-07
Built In San Francisco
Data Scientist - IntelliPro Group Inc.
2024-04-07
Company data provided by crunchbase