Skyrocket Ventures · 13 hours ago
AI / Machine Learning Infrastructure Engineer opening - Physical AI Startup
San Francisco, CA
Full-time
Hybrid
Mid Level
$220K/yr - $220K/yrSkyrocket Ventures is a recruiting firm for high growth technology companies, and they are seeking an AI / Machine Learning Infrastructure Engineer for a Physical AI Startup. This role involves programming in Go and Python, optimizing vision pipelines, and collaborating with research teams to enhance AI workflows.
EmploymentRecruiting
No H1B
Hiring Manager
Matthew Strassberg
Responsibilities
Mostly programming in Go and Python
Building the engine that powers the visual sensing platform. Providing the tools to automate the lifecycle of the AI workflow, including model development, evaluation, optimization, deployment, and monitoring across thousands of video streams
Optimizing Core Vision Pipelines: Identifying key bottlenecks in the current video analytics pipeline and performing in-depth analysis to ensure the best possible performance on current server and edge compute architectures
Cross-Stack Collaboration: Collaborating closely with AI research and platform engineering teams to optimize core parallel algorithms and influence the design of the next-generation inference infrastructure
Model Acceleration: Applying advanced model optimization techniques—such as quantization (Int8/FP16), pruning, and layer fusion—to Vision Transformers (ViTs) and CNNs to maximize throughput and minimize latency
Building Efficient Operators: Working across the entire ML framework/compiler stack (e.g., PyTorch, CUDA, TensorRT, and NVIDIA DeepStream) to write custom optimized ML operator libraries
Resource Efficiency: Reducing the compute cost per video stream to enable massive scalability of the SaaS product
Qualification
Required
A Bachelors degree and/or higher in Computer Science, or equivalent experience
Strong programming skills in Go or C or Rust or C++
Experience with model optimization, quantization, and efficient machine learning and deep learning techniques (e.g., knowledge distillation, pruning)
Deep understanding of GPU hardware performance, including execution models, thread hierarchy, memory/cache management, and the cost/performance trade-offs of video processing
Experience with profiling and benchmarking tools such as Nsight Systems or Nsight Compute to validate performance on complex architectures
Experience identifying and resolving compute and data flow bottlenecks, particularly in high-bandwidth video processing pipelines
Strong communication skills and the ability to work cross-functionally between research and infrastructure teams
Preferred
Experience with Computer Vision, Deep Learning, and Vision Transformers
Experience with video processing frameworks such as NVIDIA DeepStream, DALI, or FFmpeg
Familiarity with ML compilers (e.g., TVM, MLIR) or inference engines like TensorRT or ONNX Runtime
Knowledge of distributed training systems or cloud-scale inference serving (e.g., Triton Inference Server)
Company
Skyrocket Ventures
Skyrocket Ventures is a recruiting firm for high growth technology companies in the San Francisco Bay Area.
Founded in 2010
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase