Senior Software Engineer, Post-Training & RL Frameworks jobs in United States
cer-icon
Apply on Employer Site
company-logo

Waymo · 1 month ago

Senior Software Engineer, Post-Training & RL Frameworks

Waymo is an autonomous driving technology company focused on improving mobility and safety through its advanced driving systems. They are seeking a Senior Software Engineer to develop and enhance machine learning frameworks for reinforcement learning, collaborating with various teams to improve model performance and training workflows.

Artificial Intelligence (AI)AutomotiveAutonomous VehiclesSensorTransportation
check
H1B Sponsor Likelynote

Responsibilities

Report into the Head of ML Frameworks & Efficiency
Develop the core training system for adapting RL techniques to unprecedented scales and heterogeneous environments (i.e. CPU/GPU/TPU)
Collaborate with teams to integrate the latest rollout strategies, policies, and RL algorithms (i.e. REINFORCE, DPO, PPO) into the system
Improve the end-to-end RL training pipeline for efficient and scalable learners/actors, and low-latency distributed reply buffers for persisting data produced by the rollouts
Build evaluations, analyze experimental results and iterate quickly to improve model performance and training workflows
Stay current with the latest research in RL, Vision-Language-Action (VLA) models, and World models to inform and inspire new programs

Qualification

ML system expertiseDistributed systems designML frameworksPythonC++Profiling toolsPost-training frameworksReinforcement learning algorithmsVision-Language-Action modelsWorld models

Required

B.S. in Computer Science, Math, or 8+ years equivalent real-world experience
Proficient in distributed systems design with an understanding of ML efficiency
Experience with ML frameworks, including TensorFlow, JAX, XLA
Solid programming skills in Python and C++
Practical familiarity with profiling tools to uncover performance bottlenecks

Preferred

MS in Computer Science, Math
Familiarity with post-training frameworks like TS/REX, Tunix, TorchRL, TRL

Benefits

Waymo’s discretionary annual bonus program
Equity incentive plan
Generous Company benefits program

Company

Waymo is a mobility technology company that improves transportation by developing self-driving solutions for travelers and daily commuters. It is a sub-organization of Alphabet.

H1B Sponsorship

Waymo has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (231)
2024 (175)
2023 (268)
2022 (306)
2021 (298)
2020 (317)

Funding

Current Stage
Late Stage
Total Funding
$11.1B
Key Investors
Alphabet
2024-07-23Series C· $5.6B
2021-06-16Series B· $2.5B
2020-05-12Series A· $750M

Leadership Team

leader-logo
Tekedra Mawakana
Co-Chief Executive Officer
linkedin
leader-logo
Elisa de Martel
Chief Financial Officer
linkedin
Company data provided by crunchbase