AlphaX · 1 month ago
Back-End Engineering (Systems)
New York, New York, United States
Full-time
Onsite
Mid LevelAlphaX is hiring a Member of Technical Staff (Back-End / Systems) to join a small, deeply technical team building a next-generation platform for large-scale AI and LLM systems. This role involves working on a modern LLMOps and AI systems platform, focusing on performance, correctness, and building infrastructure that supports other engineers.
Construction
Responsibilities
You’ll help build and evolve a modern LLMOps and AI systems platform used by teams ranging from early-stage startups to large enterprises
The platform focuses on: Unified access to LLM providers via low-latency APIs, Observability for AI systems (metrics, traces, debugging tools), Optimization pipelines for cost, latency, and quality, Evaluation frameworks for individual inferences and end-to-end workflows, Experimentation infrastructure (A/B testing, fallbacks, rollouts)
On top of this platform, the team is developing an automated AI engineering system that collaborates with engineers to analyze large volumes of inference data, recommend improvements, run experiments, and prevent regressions — all with full transparency and control
Qualification
Required
Experience in building and evolving modern LLMOps and AI systems platforms
Strong understanding of low-latency APIs
Knowledge of observability for AI systems including metrics, traces, and debugging tools
Experience with optimization pipelines for cost, latency, and quality
Familiarity with evaluation frameworks for individual inferences and end-to-end workflows
Experience in developing experimentation infrastructure including A/B testing, fallbacks, and rollouts
Ability to work closely with engineers to analyze large volumes of inference data
Experience in recommending improvements and running experiments
Strong focus on performance and correctness in engineering
Company
AlphaX
AlphaX builds the AI hiring infrastructure that powers modern talent acquisition.
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase