Apply on Employer Site

Andromeda · 1 month ago

Staff Perception Engineer (US Based)

San Francisco, CA

Full-time

Onsite

Senior Level, Lead/Staff

$150K/yr - $250K/yr

5+ years exp

Andromeda Robotics is building the future of human-robot relationships with their emotionally intelligent humanoid companion robot, Abi. The Staff Perception Engineer will lead the design and implementation of Abi's perception stack, translating sensor data into semantic understanding to support autonomous navigation and conversational AI.

Artificial Intelligence (AI)Information TechnologyManufacturingRobotics

No H1B

Responsibilities

Architect the Perception Stack: Design and own the full system from raw sensors through semantic understanding, including interface contracts, compute and latency budgeting, and robust architectural decisions

Lead Cross-Functional Design: Facilitate design workshops with autonomy, conversational AI, audio engineering, ML, and hardware teams to align resources and interface definitions

Implement Strategically: Develop core perception capabilities like face recognition, speaker diarisation, person detection and tracking, and sensor fusion to validate and instantiate the architecture

Own Production Systems: Build with production-readiness in mind, including graceful degradation, monitoring, debugging tools, and deployment pipelines

Make Technical Decisions: Drive build vs. buy, algorithm choices, and embedded deployment optimisations, focusing on performance and resource constraints

Scale the Team: Support recruitment and mentoring as the perception team grows

Scene Awareness Pipeline: Architect the unified perception system that serves navigation, gesture, and conversational needs

Person Detection & Tracking: Implement robust multi-person tracking using multiple cameras, LiDAR point clouds, and IMU data for both navigation obstacle avoidance and social scene understanding

Audio-Visual Speaker Localisation: Fuse microphone arrays, face detection, gaze tracking, and skeleton pose to determine who is speaking and where Abi should direct her attention

Sensor Fusion Architecture: Design the common data structures and synchronisation primitives that enable downstream systems to consume perception outputs efficiently, optimised to run on Jetson Orin AGX within strict latency budgets

Qualification

Computer VisionSensor FusionReal-time Embedded SystemsC++PythonAudio ProcessingFace RecognitionDepth SensorsHuman Pose EstimationML Model OptimizationArchitectural SkillsPragmatic MindsetTeam Collaboration