Senior Machine Learning Engineer, LLM/VLM Visual Reasoning jobs in United States
cer-icon
Apply on Employer Site
company-logo

Waymo · 3 weeks ago

Senior Machine Learning Engineer, LLM/VLM Visual Reasoning

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. The role involves designing and implementing models for visual reasoning in autonomous driving, collaborating with engineers to integrate these capabilities into products, and optimizing model performance using advanced techniques.

Artificial Intelligence (AI)AutomotiveAutonomous VehiclesSensorTransportation
check
H1B Sponsor Likelynote

Responsibilities

Design and implement cutting-edge models and algorithms for spatial-temporal visual reasoning in autonomous driving scenarios, utilizing large language and vision models (LLM/VLM)
Develop and maintain robust training and evaluation pipelines for VLM models, focusing on metrics relevant to decision-making rationale and free-form question answering
Collaborate with ML engineers and researchers to integrate visual reasoning capabilities into product systems
Lead the effort to set up proper large-scale rationale/QA data and establish rigorous evaluation metrics for visual reasoning tasks
Explore and implement advanced techniques, including Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), to optimize model performance for complex visual reasoning challenges
Analyze and interpret large-scale sensor data to identify key challenges and opportunities for improving LLM/VLM performance in real-world driving environments

Qualification

Machine LearningLarge Language ModelsVisual ReasoningPythonDeep Learning FrameworksReinforcement LearningModel TrainingData AnalysisCollaborationProblem Solving

Required

5+ years of experience in Machine Learning, with a focus on large-scale model development (LLM, VLM, or similar foundation models)
Proven expertise in visual reasoning, scene understanding, or related areas within autonomous driving, robotics, or computer vision
Strong coding proficiency in Python and deep learning frameworks (e.g., Jax, TensorFlow, PyTorch)
Hands-on experience with model training, evaluation, and deployment in a production environment
Master's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience

Preferred

Experience with advanced training techniques, such as Supervised Fine-Tuning (SFT) or Reinforcement Learning (RL) for language/vision models
Familiarity with large-scale data curation and quality assurance processes for multimodal datasets (e.g., rationale/QA data)
Background in autonomous vehicle perception, motion planning, or decision-making systems
Publications in top-tier machine learning or computer vision conferences (e.g., NeurIPS, ICML, CVPR, ICCV, ECCV)
PhD in a relevant field

Benefits

Waymo’s discretionary annual bonus program
Equity incentive plan
Generous Company benefits program

Company

Waymo is a mobility technology company that improves transportation by developing self-driving solutions for travelers and daily commuters. It is a sub-organization of Alphabet.

H1B Sponsorship

Waymo has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (231)
2024 (175)
2023 (268)
2022 (306)
2021 (298)
2020 (317)

Funding

Current Stage
Late Stage
Total Funding
$11.1B
Key Investors
Alphabet
2024-07-23Series C· $5.6B
2021-06-16Series B· $2.5B
2020-05-12Series A· $750M

Leadership Team

leader-logo
Tekedra Mawakana
Co-Chief Executive Officer
linkedin
leader-logo
Elisa de Martel
Chief Financial Officer
linkedin
Company data provided by crunchbase