Apply on Employer Site

Genmo · 6 months ago

GPU Performance Engineer

San Francisco HQ

Full-time

Onsite

Mid, Senior Level

5+ years exp

Genmo is an artificial intelligence creative content generation platform that specializes in developing creative products. They are seeking a GPU Performance Engineer to optimize their model serving stack and achieve significant performance improvements in video generation. The role involves using advanced profiling tools, writing custom CUDA kernels, and collaborating with ML engineers to enhance overall performance.

Artificial Intelligence (AI)ContentDigital Entertainment

Responsibilities

Profile and optimize GPU workloads using Nsight Systems, nvprof, and custom instrumentation

Write high-performance CUDA and Triton kernels for critical model operations

Optimize cold start latency from seconds to milliseconds for our serving infrastructure

Tune memory access patterns, kernel fusion, and GPU utilization

Collaborate with ML engineers to optimize model implementations

Debug performance issues across the full stack from application to hardware

Implement custom memory pooling and allocation strategies

Share optimization techniques and build performance culture across teams

Qualification

GPU optimizationCUDA programmingGPU profiling toolsPythonC++Triton kernel developmentCUTLASSML-specific optimizationsRDMA/InfiniBand optimizationLow-level debuggingGPU architecture knowledge