Platform Engineer – AI/ML Infrastructure jobs in United States
cer-icon
Apply on Employer Site
company-logo

Deepgram · 5 months ago

Platform Engineer – AI/ML Infrastructure

Deepgram is the leading voice AI platform for developers building speech-to-text and text-to-speech offerings. They are seeking a Senior/Staff-level Platform Engineer to build and operate the hybrid infrastructure foundation for advanced AI/ML research and product development, focusing on Kubernetes, AWS, and Infrastructure-as-Code principles.

Artificial Intelligence (AI)Data Collection and LabelingDeveloper APIsNatural Language ProcessingSpeech Recognition
check
H1B Sponsor Likelynote

Responsibilities

Architect and maintain our core computing platform using Kubernetes on AWS and on-premise, providing a stable, scalable environment for all applications and services
Develop and manage our entire infrastructure using Infrastructure-as-Code (IaC) principles with Terraform, ensuring our environments are reproducible, versioned, and automated
Design, build, and optimize our AI/ML job scheduling and orchestration systems, integrating Slurm with our Kubernetes clusters to efficiently manage GPU resources
Provision, manage, and maintain our on-premise bare metal server infrastructure for high-performance GPU computing
Implement and manage the platform's networking (CNI, service mesh) and storage (CSI, S3) solutions to support high-throughput, low-latency workloads across hybrid environments
Develop a comprehensive observability stack (monitoring, logging, tracing) to ensure platform health, and create automation for operational tasks, incident response, and performance tuning
Collaborate with AI researchers and ML engineers to understand their infrastructure needs and build the tools and workflows that accelerate their development cycle
Automate the life cycle of single-tenant, managed deployments

Qualification

KubernetesTerraformSlurmAWSBare metal infrastructureHigh-performance computingScripting skillsCI/CD systemsFinOps principlesKubernetes networkingMulti-region cloud

Required

5+ years of experience in Platform Engineering, DevOps, or Site Reliability Engineering (SRE)
Proven, hands-on experience building and managing production infrastructure with Terraform
Expert-level knowledge of Kubernetes architecture and operations in a large-scale environment
Experience with high-performance compute (HPC) job schedulers, specifically Slurm, for managing GPU-intensive AI workloads
Experience managing bare metal infrastructure, including server provisioning (e.g., PXE boot, MAAS), configuration, and lifecycle management
Strong scripting and automation skills (e.g., Python, Go, Bash)

Preferred

Experience with CI/CD systems (e.g., GitLab CI, Jenkins, ArgoCD) and building developer tooling
Familiarity with FinOps principles and cloud cost optimization strategies
Knowledge of Kubernetes networking (e.g., Calico, Cilium) and storage (e.g., Ceph, Rook) solutions
Experience in a multi-region or hybrid cloud environment

Company

Deepgram

twittertwittertwitter
company-logo
Deepgram specializes in providing AI-powered speech-to-text technology that offers audio intelligence, text-to-speech, and voice agent API.

H1B Sponsorship

Deepgram has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (1)
2022 (1)

Funding

Current Stage
Growth Stage
Total Funding
$85.92M
Key Investors
Tiger Global ManagementIQTWing Venture Capital
2022-11-26Series B· $47M
2021-02-03Series B· $25M
2020-06-04Series Unknown

Leadership Team

leader-logo
Scott Stephenson
Co-Founder and CEO
linkedin
leader-logo
Adam Sypniewski
Chief Technology Officer
linkedin
Company data provided by crunchbase