Perplexity · 3 weeks ago
Member of Technical Staff (Software Engineer, Inference & Training Platform)
United States+1 more
Full-time
Remote
Lead/Staff
$250K/yr - $485K/yrPerplexity serves hundreds of millions of queries a month, and they are seeking a Member of Technical Staff to take ownership of the infrastructure behind their AI inference requests. The role involves building a self-serve platform for training and inference workloads while managing a large GPU fleet across various cloud providers.
Artificial Intelligence (AI)ChatbotMachine LearningNatural Language ProcessingSearch EngineSemantic Search
Responsibilities
Build a self-serve compute platform. Design and own the systems that let inference engineers and researchers launch training jobs and operate inference services without managing GPU provisioning, cluster configuration, or provider-specific infrastructure
Operate the GPU fleet. Own provisioning, lifecycle management, reliability, and capacity integration across providers, giving teams a consistent way to use compute regardless of where it runs
Solve for GPU scarcity. Build the scheduling and placement logic that finds available capacity across providers, packs it efficiently, and gets the right workload onto the right hardware under real constraints
Support two very different workloads. Keep long-running distributed training jobs healthy while simultaneously guaranteeing the availability and latency of production inference services on the same fleet
Own the Kubernetes for GPU orchestration. Write the operators and CRDs, and manage many clusters across providers so the platform behaves the same everywhere we run
Make failure boring. Build the fault tolerance, autoscaling, and observability that keep the fleet utilized and let workloads survive node loss, provider hiccups, and capacity shifts without human intervention
Set technical direction across teams. Partner with inference and cloud infrastructure engineers to turn operational constraints into a coherent platform architecture and roadmap
Qualification
Required
Deep Kubernetes experience — custom operators, CRDs, and multi-cluster federation, not just running kubectl apply
You've managed GPU clusters at scale: NVIDIA hardware, CUDA, and the networking that makes them fast (InfiniBand or RoCE)
You've orchestrated compute across multiple clouds (CoreWeave, AWS, GCP, or similar) and understand how different each one really is
Strong distributed systems fundamentals: scheduling, resource allocation, and fault tolerance under load
You write infrastructure and systems-level code in Go, Rust or C++
You've supported both long-running training jobs and high-availability inference services, and you know why they pull infrastructure in opposite directions
You own problems end-to-end and do well when the path forward isn't laid out for you
Preferred
Inference serving stacks: vLLM, SGLang, or TensorRT-LLM
Slurm or other HPC schedulers
GPU kernel work in CUDA or Triton — not required, but notable
High-speed interconnects: InfiniBand, RoCE, or RDMA in production
Observability for ML workloads: Prometheus, Grafana, or Weights & Biases
Company
Perplexity
Perplexity is an AI-powered platform that retrieves, analyzes information from the web to deliver structured answers with cited sources.
Founded in 2022
201-500 employees
H1B Sponsorship
Perplexity has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
27%
Represents job field similar to this job
Engineering and Development
Customer Service and Support
Product Management
Accounting and Finance
Management and Executive
Trends of Total Sponsorships
*2026 (10)
2025 (11)
2024 (7)
2023 (2)
Funding
Current Stage
Late StageTotal Funding
$1.48BKey Investors
Cristiano RonaldoNuVenturesAccel
2026-02-23Series Unknown· $5.5M
2025-12-05Undisclosed
2025-09-10Series Unknown· $200M
Leadership Team
Aravind Srinivas
CEO & Co-Founder
Denis Yarats
Co-Founder & CTO
Recent News
Retail Insight Network
2026-08-07
2026-08-06
2026-08-06
Company data provided by crunchbase