Virtue AI · 4 weeks ago
Cloud Engineering - Cloud / Platform Engineer
San Francisco
Full-time
Onsite
Mid, Senior LevelVirtue AI sets the standard for advanced AI security platforms, and they are seeking a Cloud / Platform Engineer to own the deployment and operation of their platform in customer environments. The role involves designing deployment workflows on AWS and GCP, building production-grade cloud infrastructure, and collaborating with various teams to ensure infrastructure aligns with model behavior and performance needs.
Artificial Intelligence (AI)Information TechnologySoftware
Responsibilities
Design and maintain one-click deployment workflows for Virtue AI on AWS and GCP
Build and operate production-grade cloud infrastructure for AI inference, agents, and guardrails
Own IaC (Terraform / Pulumi) for repeatable, auditable customer deployments
Package our services into secure, customer-ready deployment units (Docker, Helm, Marketplace images)
Enable GPU-backed inference (H100/A100/L4, etc.) with correct autoscaling, scheduling, and cost controls
Implement secure networking (VPCs, IAM, service accounts, private endpoints, firewalling)
Collaborate with backend, ML, and research teams to align infrastructure with model behavior, evals, and throughput needs
Debug and unblock customer deployments across cloud, hybrid, and restricted environments
Improve reliability, observability, and rollout safety (logging, metrics, health checks, rollback)
Qualification
Required
Bachelor's degree or higher in CS, CE, EE, or related field
Strong experience deploying production systems on AWS and/or GCP
Deep hands-on experience with: Docker and containerized workloads, Terraform or Pulumi, Kubernetes (EKS, GKE, or equivalent)
Experience designing secure cloud architectures (IAM, VPCs, private networking)
Experience deploying GPU workloads in the cloud
Strong scripting skills (Python, Bash, or Go)
Ability to own infrastructure end-to-end and support real customers
Experience in packaging products for: AWS Marketplace, GCP Marketplace, Helm-based enterprise installs
Preferred
Experience deploying ML / LLM inference systems at scale
Familiarity with vLLM, sglang, Triton, or similar inference stacks
Experience with hybrid or on-prem deployments
Startup experience: you move fast, document what matters, and fix things properly
Benefits
Equity commensurate with skills and experience
Impact at scale – Help define the category of AI security and partner with Fortune 500 enterprises on their most strategic AI initiatives.
Work on the frontier – Engage with bleeding-edge AI/ML and deploy AI security solutions for use cases that don't yet exist anywhere else yet.
Collaborative culture – Join a team of builders, problem-solvers, and innovators who are mission-driven and collaborative.
Opportunity for growth – Shape not only our customer engagements, but also the processes and culture of an early lean team with plans for scale.
Company
Virtue AI
Virtue AI operates as an AI security and compliance platform for applications.
Founded in 2024
11-50 employees
H1B Sponsorship
Virtue AI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Early StageTotal Funding
$30M2025-04-15Series A· $30M
2025-04-15Seed
Leadership Team
Bo Li
CEO
Carlos Guestrin
Co-Founder & Chief Scientist
Recent News
2025-10-31
Company data provided by crunchbase