Apply on Employer Site

Advanced Microdevices Pvt. Ltd. (India) · 4 weeks ago

Staff Software Development Engineer - AI/ML Frameworks, C/C++/Python

San Jose, CA

Full-time

Hybrid

Lead/Staff

Advanced Micro Devices, Inc is dedicated to building products that enhance next-generation computing experiences. They are seeking a world-class AI frameworks engineer to lead the development and optimization of deep learning frameworks for AMD GPUs, collaborating with internal teams and open-source maintainers to drive continuous improvement.

BiopharmaBiotechnologyIndustrialManufacturing

No H1B

Responsibilities

Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open-source repositories

Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations

Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance

Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs

Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream

Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions

Qualification

AI/ML frameworksGPU kernel developmentC++ programmingPython programmingDeep learning optimizationProfilingBenchmarkingModel architecturesCollaboration skillsTeam player

Required

BS, MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields

Preferred

GPU Kernel Development & Optimization: Experienced in designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly (ASM). Strong knowledge of AMD architectures (GCN, RDNA) and low-level programming to maximize performance for AI operations, leveraging tools like Compute Kernel (CK), CUTLASS, and Triton for multi-GPU and multi-platform performance

Experience with AI software framework, such as PyTorch, vLLM, SGLang, benchmarking and profiling

Experience using profiling and benchmark tooling for large models

Experience with model optimization, such as low-precision quantization (MXFP4, FP8, INT4), sparsity

Solid understanding of model architectures, LLMs, MoE, diffusion

Proficient in C++ programming

Experience developing and debugging in Python

Team player and ready to work with a geographically distributed team