Together AI · 1 day ago
Staff Engineer, Distributed Storage and HPC & AI Infrastructure
San Francisco, CA
Full-time
Hybrid
Lead/Staff
$160K/yr - $260K/yr
8+ years expTogether AI is a research-driven artificial intelligence company focused on creating innovative AI systems. The role involves designing and delivering advanced storage systems for AI workloads, optimizing data paths, and building Kubernetes-native storage solutions.
Artificial Intelligence (AI)Generative AIInternetIT InfrastructureOpen Source
Responsibilities
Design multi-petabyte AI/ML storage systems; integrate WekaFS, Ceph, etc.; lead capacity planning and cost optimization (30-50% savings via tiering, lifecycle policies, right-sizing)
Design/optimize RDMA, InfiniBand, 400GbE networks; tune for max throughput/min latency; implement NVMe-oF/iSCSI; troubleshoot bottlenecks; optimize TCP/IP for storage
Build Kubernetes storage operators/controllers; enable automated provisioning, self-service abstractions, multi-tenant isolation, quotas; create reusable Helm/Terraform patterns
Deliver 10-50 GB/s per GPU node; optimize caching (weights/datasets/checkpoints), parallel filesystems, and data paths; troubleshoot with profiling tools; scale to thousands of nodes
Build multi-tier caches (local NVMe, distributed, object); optimize data locality and model-weight distribution; implement smart prefetching/eviction
Implement monitoring, alerting, SLOs; design DR/backups with runbooks; run chaos engineering; ensure 99.9%+ uptime via proactive/automated remediation
Partner with ML/SRE teams; mentor on storage best practices; contribute to open-source; write docs, postmortems, and public learnings
Qualification
Required
8+ years in storage engineering with 3+ years managing distributed storage at multi-petabyte scale
Proven track record deploying and operating high-performance storage for GPU/HPC clusters
Deep Kubernetes and cloud-native storage experience in production environments
Strong coding skills in Go and Python with demonstrated ability to build production-grade tools
BS/MS in Computer Science, Engineering, or equivalent practical experience
History of technical leadership: designing systems that significantly improved performance (>3x), reliability (99.9%+ uptime), or cost efficiency
Distributed Storage Systems: Deep expertise in WekaFS, Lustre, GPFS, BeeGFS, or similar parallel filesystems at multi-petabyte scale
Object Storage: Production experience with S3, MinIO, Ceph, or R2 including performance optimization and cost management
Kubernetes Storage: CSI drivers, StatefulSets, PersistentVolumes, storage operators, and custom controllers
Storage optimization for GPU workloads, RDMA/InfiniBand networking, parallel filesystem optimization (100+ GB/s aggregate cluster throughput)
Programming: Go and Python for automation, operators, and tooling
Infrastructure as Code: Terraform, Ansible, Helm, GitOps (ArgoCD)
Linux Storage Stack: Advanced knowledge of filesystems (ext4, xfs), LVM, NVMe optimization, RAID configurations
Observability: Prometheus, Grafana, Thanos architecture and operations
Preferred
GPU Direct Storage (GDS), NVMe-oF, storage networking (100GbE/400GbE)
ML/AI storage patterns (model weights, checkpointing, dataset caching)
Kubernetes operator development (controller-runtime, kubebuilder)
Storage snapshots, cloning, and thin provisioning
Backup and disaster recovery (Velero, Restic, cross-region replication)
Storage encryption (at-rest and in-transit), security and compliance
Storage benchmarking and profiling tools (fio, iperf3, iostat, blktrace)
Benefits
Competitive compensation
Startup equity
Health insurance
Flexibility in terms of remote work
Company
Together AI
Together AI is a cloud-based platform designed for constructing open-source generative AI and infrastructure for developing AI models.
201-500 employees
H1B Sponsorship
Together AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (19)
2024 (6)
2023 (3)
Funding
Current Stage
Growth StageTotal Funding
$533.5MKey Investors
Salesforce VenturesLux Capital
2025-02-20Series B· $305M
2024-03-13Series A· $106M
2023-11-29Series A· $102.5M
Leadership Team
Vipul Ved Prakash
Co-Founder & CEO
Kae Ike Lim
Executive Assistant to Co-Founder and CEO
Recent News
2025-11-27
Company data provided by crunchbase