Staff Software Development Engineer - AI/ML Frameworks, C/C++/Python jobs in United States
cer-icon
Apply on Employer Site
company-logo

AMD · 8 hours ago

Staff Software Development Engineer - AI/ML Frameworks, C/C++/Python

AMD is a company focused on building innovative products that enhance computing experiences across various domains. The role involves providing technical leadership in the development of AI frameworks, optimizing deep learning frameworks for AMD GPUs, and collaborating with both internal teams and open-source maintainers.

Artificial Intelligence (AI)Cloud ComputingComputerEmbedded SystemsGPUHardwareSemiconductor
check
Growth Opportunities
badNo H1Bnote
Hiring Manager
Tressa Cooper (she/her)
linkedin

Responsibilities

Optimize Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open-source repositories
Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations
Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance
Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs
Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream
Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions

Qualification

AI/ML frameworksGPU Kernel DevelopmentC++ programmingPythonDeep Learning OptimizationProfilingBenchmarkingModel OptimizationCollaborationLeadershipTeam player

Required

Technical leadership in the development of various AI frameworks in the AMD ecosystem
Developing and optimizing deep learning frameworks for AMD GPUs
Engaging with both internal GPU library teams and open-source maintainers
Utilizing cutting-edge compiler technologies and advanced engineering principles
Working in a dynamic development environment
Excellent leadership and collaboration skills
Guiding other senior developers and domain experts
Optimizing Deep Learning Frameworks: Enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open-source repositories
Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific AI operations
Develop & Optimize Models: Design and optimize deep learning models using quantization specifically for AMD GPU performance
Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve training and inference performance on AMD GPUs
Collaborate with Open-Source Maintainers: Engage with framework maintainers to ensure code changes are aligned with requirements and integrated upstream
Apply sound engineering principles to ensure robust, maintainable solutions
BS, MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or related technical fields

Preferred

Experienced in designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly (ASM)
Strong knowledge of AMD architectures (GCN, RDNA) and low-level programming to maximize performance for AI operations
Leveraging tools like Compute Kernel (CK), CUTLASS, and Triton for multi-GPU and multi-platform performance
Experience with AI software framework, such as PyTorch, vLLM, SGLang, benchmarking and profiling
Experience using profiling and benchmark tooling for large models
Experience with model optimization, such as low-precision quantization (MXFP4, FP8, INT4), sparsity
Solid understanding of model architectures, LLMs, MoE, diffusion
Proficient in C++ programming
Experience developing and debugging in Python
Team player and ready to work with a geographically distributed team

Benefits

AMD benefits at a glance.

Company

Advanced Micro Devices is a semiconductor company that designs and develops graphics units, processors, and media solutions.

Funding

Current Stage
Public Company
Total Funding
unknown
Key Investors
OpenAIDaniel Loeb
2025-10-06Post Ipo Equity
2023-03-02Post Ipo Equity
2021-06-29Post Ipo Equity

Leadership Team

leader-logo
Lisa Su
Chair & CEO
linkedin
leader-logo
Mark Papermaster
CTO and EVP
linkedin
Company data provided by crunchbase