Virtue AI · 1 month ago
Cloud Engineering - Cloud / Platform Engineer
San Francisco, CA
Full-time
Onsite
Mid LevelVirtue AI is an early-stage startup focused on advanced AI security platforms. As a Cloud / Platform Engineer, you will be responsible for deploying, scaling, and operating Virtue AI's platform in customer environments, enabling seamless transitions from proof of concept to production.
Artificial Intelligence (AI)Information TechnologySoftware
Responsibilities
Design and maintain one-click deployment workflows for Virtue AI on AWS and GCP
Build and operate production-grade cloud infrastructure for AI inference, agents, and guardrails
Own IaC (Terraform / Pulumi) for repeatable, auditable customer deployments
Package our services into secure, customer-ready deployment units (Docker, Helm, Marketplace images)
Enable GPU-backed inference (H100/A100/L4, etc.) with correct autoscaling, scheduling, and cost controls
Implement secure networking (VPCs, IAM, service accounts, private endpoints, firewalling)
Collaborate with backend, ML, and research teams to align infrastructure with model behavior, evals, and throughput needs
Debug and unblock customer deployments across cloud, hybrid, and restricted environments
Improve reliability, observability, and rollout safety (logging, metrics, health checks, rollback)
Qualification
Required
Bachelor's degree or higher in CS, CE, EE, or related field
Strong experience deploying production systems on AWS and/or GCP
Deep hands-on experience with: Docker and containerized workloads, Terraform or Pulumi, Kubernetes (EKS, GKE, or equivalent)
Experience designing secure cloud architectures (IAM, VPCs, private networking)
Experience deploying GPU workloads in the cloud
Strong scripting skills (Python, Bash, or Go)
Ability to own infrastructure end-to-end and support real customers
Experience in packaging products for: AWS Marketplace, GCP Marketplace, Helm-based enterprise installs
Preferred
Experience deploying ML / LLM inference systems at scale
Familiarity with vLLM, sglang, Triton, or similar inference stacks
Experience with hybrid or on-prem deployments
Startup experience: you move fast, document what matters, and fix things properly
Benefits
Competitive base salary compensation + equity commensurate with skills and experience.
Impact at scale – Help define the category of AI security and partner with Fortune 500 enterprises on their most strategic AI initiatives.
Work on the frontier – Engage with bleeding-edge AI/ML and deploy AI security solutions for use cases that don't yet exist anywhere else yet.
Collaborative culture – Join a team of builders, problem-solvers, and innovators who are mission-driven and collaborative.
Opportunity for growth – Shape not only our customer engagements, but also the processes and culture of an early lean team with plans for scale.
Company
Virtue AI
Virtue AI operates as an AI security and compliance platform for applications.
Founded in 2024
11-50 employees
H1B Sponsorship
Virtue AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageTotal Funding
$30M2025-04-15Series A· $30M
2025-04-15Seed
Leadership Team
Bo Li
CEO
Carlos Guestrin
Co-Founder & Chief Scientist
Recent News
2025-10-31
Company data provided by crunchbase