Cresta · 2 hours ago
Staff Software Engineer, Backend (AI Platform)
United States
Full-time
Remote
Senior Level, Lead/Staff
5+ years expCresta is on a mission to turn every customer conversation into a competitive advantage by unlocking the true potential of the contact center. The role involves owning model serving, automating training pipelines, optimizing at scale, building platform primitives, and mentoring engineers on production ML best practices.
Artificial Intelligence (AI)Intelligent SystemsMachine LearningNatural Language ProcessingTelecommunications
Responsibilities
Own model serving: Design, build, and maintain low-latency, highly-available serving stacks for in-house ML model serving and integrating with LLM serving partners
Automate training pipelines: Orchestrate data prep, training, evaluation, and registry workflows on Kubernetes with solid MLOps practices
Optimize at scale: Profile and tune throughput, memory, and cost; introduce caching, sharding, batching, and GPU/CPU autoscaling where it pays off
Build platform primitives: Create reusable SDKs, templates, and CLI tools that let research and product teams ship models independently and safely
Raise the bar: Instrument deep observability (tracing, metrics, alerts), drive blameless post-mortems, and mentor engineers on production ML best practices
Qualification
Required
5+ years writing production software; 2+ years focused on ML platform or infra
Expert Python (async, typing, packaging, performance)
Working Golang knowledge for systems components
Proven experience with one or more serving frameworks (e.g., vLLM, Triton, TorchServe)
Kubernetes and cloud-native ops
Solid grasp of distributed systems, networking, and container security
Culture of rigorous testing, code review, and continuous delivery
Preferred
Hands-on with large language models or real-time streaming inference
Terraform, Helm, or similar IaC tooling
Experience in speech or conversational AI domains
Benefits
Comprehensive medical, dental, and vision coverage with plans to fit you and your family
Flexible PTO to take the time you need, when you need it
Paid parental leave for all new parents welcoming a new child
Retirement savings plan to help you plan for the future
Remote work setup budget to help you create a productive home office
Monthly wellness and communication stipend to keep you connected and balanced
In-office meal program and commuter benefits provided for onsite employees
Company
Cresta
Cresta uses artificial intelligence to assist sales and service agents in the quality of customer service.
201-500 employees
H1B Sponsorship
Cresta has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (6)
2023 (2)
2022 (10)
2021 (4)
2020 (3)
Funding
Current Stage
Late StageTotal Funding
$276MKey Investors
Tiger Global ManagementSequoia CapitalGreylock
2024-11-19Series D· $125M
2022-03-17Series C· $80M
2021-03-31Series B· $50M
Leadership Team
Ping Wu
CEO
Tim Shi
Co-Founder, Board Member
Recent News
Greylock
2025-12-02
Company data provided by crunchbase