Research Scientist Intern, PyTorch Compiler (PhD) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Meta · 15 hours ago

Research Scientist Intern, PyTorch Compiler (PhD)

Meta builds technologies that help people connect, find communities, and grow businesses. They are seeking a Research Scientist Intern to develop new techniques in PyTorch and optimize Generative AI models while conducting cutting-edge research on ML compiler and ML distributed technologies.

Computer Software
check
Comp. & Benefits

Responsibilities

Develop new techniques in TorchDynamo, TorchInductor, PyTorch core, PyTorch Distributed
Explore the intersection of PyTorch compiler and PyTorch Distributed
Optimize Generative AI models across the stack (pre-training, fine-tuning, and inference)
Improve general PyTorch performance
Conduct cutting-edge research on ML compiler and ML distributed technologies
Collaborate with users of PyTorch to enable new use cases for the framework both inside and outside Meta

Qualification

ML compilerDistributed TrainingPythonCuda programmingPerformance optimizationCross-functional communication

Required

Currently has or is in the process of obtaining a PhD degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
Experience in ML compiler, Distributed Training, ML systems, or similar
Proficient in Python or Cuda programming
Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Preferred

Experience working on other ML compiler stack, especially on PT2 stack or Triton
Experience doing performance optimization on machine learning models
Intent to return to degree program after the completion of the internship/co-op
Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as NeurIPS, MLSys, ASPLOS, PLDI, CGO, PACT, ICML, or similar
Experience working and communicating cross functionally in a team environment

Company

Meta's mission is to build the future of human connection and the technology that makes it possible.

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Kathryn Glickman
Director, CEO Communications
linkedin
leader-logo
Christine Lu
CTO Business Engineering NA
linkedin
Company data provided by crunchbase