Apply on Employer Site

Pathway · 2 months ago

Machine Learning Researcher / Engineer (Foundational Models)

Palo Alto, CA

Full-time

Hybrid

Mid, Senior Level

$100K/yr - $1,000K/yr

Pathway is an innovative company revolutionizing artificial intelligence with its groundbreaking post-transformer model. The role involves conducting research and development in attention-based models, focusing on model training and architecture adaptation to enhance project outcomes.

Artificial Intelligence (AI)

Responsibilities

Perform (distributed) model training

Help improve/adapt model architectures based on experiment results

Design new tasks and experiments

Optionally: oversee activities of team members involved in data preparation

Qualification

Machine Learning ResearchDeep LearningModel TrainingPyTorchGPU ArchitectureGraph AlgorithmsRespectful of othersModel MonitoringGitCI/CDFluent in English

Required

You have published at least one paper at NeurIPS, ICLR, or ICML - where you were the lead author or made significant conceptual & code contributions

You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface benchmark, best in class model, etc.), preferably using multiple GPU's

You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA)

You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School

A deep learning researcher, with a track record in Language Models and/or RL (candidates with a Vision or Robotics ML background are also welcome to apply)

Interested in improving foundational architectures and creating new benchmarks

Experienced at hands-on experiments and model training (PyTorch, Jax, or Tensorflow)

Have a good understanding of GPU architecture, memory design, and communication

Have a good understanding of graph algorithms

Have some familiarity with model monitoring, git, build systems, and CI/CD

Respectful of others

Fluent in English