FriendliAI · 13 hours ago
Forward Deployed Engineer - Cloud Infrastructure & Inference
New York, NY
Full-time
Onsite
Mid Level
$160K/yr - $230K/yr
3+ years expFriendliAI is building the next-generation AI inference platform that accelerates the deployment of large language and multimodal models. They are seeking a Forward Deployed Engineer to assist enterprises in deploying, scaling, and operating AI workloads, working directly with customers to implement production-grade applications.
Artificial Intelligence (AI)Generative AIInformation TechnologyInternetSaaSSoftware
Hiring Manager
Woojin Lee
Responsibilities
Design and implement large-scale deployment architectures for LLM and multimodal inference
Deploy and manage containerized workloads across Kubernetes clusters
Diagnose production issues, such as performance bottlenecks, and implement temporary fixes as needed
Collaborate with customers’ DevOps teams to integrate FriendliAI’s infrastructure into their CI/CD workflows
Develop scripts, Helm charts, and Terraform modules that simplify repeated deployments
Contribute field insights to shape our platform reliability, observability, and scaling strategies
Lead workshops, technical sessions, or webinars to help customers master infrastructure best practices
Qualification
Required
3+ years of experience in cloud infrastructure, DevOps, or reliability engineering
Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
Proficiency with Kubernetes, Docker, Terraform, and Helm
Strong foundation in distributed systems, networking, and performance tuning
Familiarity with GPU-based computing and model serving workloads
Strong technical background in backend systems or AI tooling
Experience operating workloads on AWS, GCP, or OCI
Excellent problem-solving and debugging skills in real-world environments
Preferred
Experience deploying large models (LLMs, diffusion models) on GPUs or clusters
Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference)
Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL)
Understanding of networking security and compliance frameworks (e.g., SOC 2)
Experience supporting on-prem or hybrid-cloud deployments
Benefits
A front-row seat to the generative AI infrastructure revolution
Competitive compensation and benefits package
Daily lunch and dinner provided; unlimited snacks and beverages
Health check-up and top-tier hardware support
Flexible working hours and a highly collaborative environment
Company
FriendliAI
FriendliAI is an AI infrastructure company that enables deployment, scaling, and monitoring of large language and multimodal models.
11-50 employees
Funding
Current Stage
Early StageTotal Funding
$26.75MKey Investors
Capstone Partners
2025-08-28Seed· $20M
2021-12-15Seed· $6.75M
Leadership Team
Byung-Gon Chun
Chief Executive Officer
Gyeong-In Yu
Chief Technology Officer
Recent News
Inside HPC & AI News | High-Performance Computing & Artificial Intelligence
2025-12-20
2025-12-16
2025-10-28
Company data provided by crunchbase