Software Engineer - Perception Scene Understanding jobs in United States
cer-icon
Apply on Employer Site
company-logo

Zoox · 6 days ago

Software Engineer - Perception Scene Understanding

Zoox is developing the first ground-up, fully autonomous vehicle fleet, and they are seeking a Software Engineer in the Perception Scene Understanding team. The role involves designing and implementing visual scene understanding solutions for robotaxis and developing advanced ML models to perceive the vehicle's surroundings, ensuring safe driving in complex environments.

Artificial Intelligence (AI)Autonomous VehiclesMachine LearningRoboticsTransportation
check
H1B Sponsor Likelynote

Responsibilities

Design and implement visual scene understanding solutions for robotaxis
Lead end-to-end data strategy, including mining, auto-labeling, and dataset construction to power our ML flywheel
Build and utilize vision-language models for rare hazard detection and scene reasoning
Utilize our large-scale data pipelines and ML infrastructure to research, prototype, and deploy solutions that improve driving behavior
Partner with cross-functional teams to integrate perception signals

Qualification

Deep learningVision-language modelsObject detectionProduction ML pipelinesPython librariesDataset creationResearch publicationsCross-functional collaboration

Required

MS or PhD in Computer Science or related field
Background in deep learning solutions for vision-language models, large language models, object detection or scene understanding
Track record of training and deploying state-of-the-art deep learning models
Hands-on experience with production ML pipelines, including dataset creation, training frameworks, and metrics
Expertise in Python libraries (PyTorch, NumPy, Pandas)

Preferred

Deep knowledge of cutting-edge computer vision techniques
Publications in top-tier conferences (CVPR, ICCV, RSS, ICRA)
Experience with integrating large language models to various tasks

Benefits

Paid time off (e.g. sick leave, vacation, bereavement)
Unpaid time off
Zoox Stock Appreciation Rights
Amazon RSUs
Health insurance
Long-term care insurance
Long-term and short-term disability insurance
Life insurance

Company

Zoox is an AI robotics company that provides mobility-as-a-service and self-driving car services. It is a sub-organization of Amazon.

H1B Sponsorship

Zoox has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (293)
2024 (297)
2023 (209)
2022 (204)
2021 (131)
2020 (83)

Funding

Current Stage
Late Stage
Total Funding
$955M
Key Investors
Grok Ventures
2020-06-26Acquired
2019-10-21Convertible Note· $200M
2018-07-08Series B· $465M

Leadership Team

leader-logo
Nelson Pedreiro
Sr. Vice President, Hardware
linkedin
Z
Zheng Gao
Director of Hardware Engineering
linkedin
Company data provided by crunchbase