Talent Zone Consultant · 3 days ago
Senior, Staff Backend Engineer - Distributed System
Palo Alto, CA
Full-time
Onsite
Senior Level, Lead/Staff
$130K/yr - $170K/yr
5+ years expTalent Zone Consultant is seeking a Senior, Staff Backend Engineer specializing in Distributed Systems. The role involves designing APIs for GPU operations, developing resource management systems, and optimizing scheduling algorithms to enhance GPU utilization.
ConsultingHuman ResourcesRecruitingStaffing Agency
Responsibilities
Design APIs that abstract complex GPU operations into simple developer experiences
Build scheduling algorithms that maximize GPU utilization while ensuring SLA compliance
Develop resource management systems for GPU lifecycle—provisioning, allocation, scheduling, and release
Create usage tracking and billing systems for GPU-hours, memory usage, and compute utilization
Implement monitoring for GPU-specific metrics, health checks, and automatic failure recovery
Build multi-tenancy systems with resource isolation, quota management, and fair scheduling
Optimize cold starts for model serving and implement efficient model loading strategies
Collaborate with frontend engineers to expose complex infrastructure through intuitive interfaces
Leverage AI-assisted coding tools (GitHub Copilot, Claude Code, Cursor IDE, etc.) to boost productivity and code quality
Qualification
Required
5+ years backend engineering experience with distributed systems
Strong proficiency in Go, Python, or similar backend languages
Experience with resource scheduling, orchestration, and API design (REST, GraphQL, gRPC)
Understanding of hardware constraints and system optimization
Linux systems knowledge and containerization experience (Docker, Kubernetes)
Comfortable working with expensive resources where efficiency directly impacts costs
Excited about solving novel problems in AI infrastructure (not just another CRUD app)
Startup mindset—comfortable with ambiguity and rapid iteration
Preferred
GPU or HPC cluster management experience
Understanding of ML, AI workload patterns and requirements
Experience with high-value resource allocation systems
Background in performance optimization for compute-intensive workloads
Familiarity with GPU virtualization and sharing technologies
Experience building billing or metering systems
Company
Talent Zone Consultant
TALENT ZONE Consultants is a unique and flourishing Human Resource Consultancy in Bangalore, Karnataka.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase