AMD · 1 hour ago
Software R&D Engineer – GPU Kernel Development
Orlando, FL
Full-time
Onsite
Senior LevelAMD is a leading company dedicated to building innovative products that enhance computing experiences across various domains including AI and gaming. The Software R&D Engineer – GPU Kernel Development role focuses on developing and optimizing GPU kernels for machine learning and high-performance computing workloads, ensuring maximum performance and efficiency.
AI InfrastructureArtificial Intelligence (AI)Cloud ComputingComputerEmbedded SystemsGPUHardwareSemiconductor
Responsibilities
Develop GPU Kernels: Create and optimize GPU kernels to maximize performance for specific ML/AI/HPC workloads on pre-silicon architectures
Develop & Optimize Models: Design and optimize low-level GPU kernels to accelerate inference and training of large machine learning models. Maximize computational efficiency and reduce execution time while ensuring model accuracy
Multi-GPU and Multi-Node Optimization: Design and implement strategies for distributed model training and inference across multiple GPUs and nodes. Address data parallelism and model parallelism challenges to fully utilize available resources
Performance Profiling: Profile and analyze system and application performance to identify bottlenecks and areas for improvement. Use profiling tools to understand and optimize hardware resource utilization
Parallel Computing: Leverage parallel computing techniques to improve the scalability and performance of machine learning workloads. Implement multi-threading and GPU synchronization techniques
Benchmarking and Testing: Develop benchmarks and testing procedures to assess the performance and stability of optimized models and frameworks. Ensure that the solutions meet or exceed the defined performance criteria
ML Frameworks: Use, enhance and optimize frameworks like PyTorch, vLLM, SGLang for AMD GPUs in open-source repositories
Collaborate with GPU Library Teams: Work closely with internal teams to analyze and improve workloads performance on AMD GPUs and pre-silicon architectures
Software Engineering Best Practices: Apply sound engineering principles to ensure robust, maintainable solutions
Documentation: Create detailed documentation of optimizations, best practices, and implementation guidelines to facilitate knowledge sharing and maintainable code
Qualification
Required
Proficient in C++ programming, C++17 and/or C++20
Experienced in designing and optimizing GPU kernels on AMD/Nvidia GPUs using HIP, CUDA, and/or assembly (ASM)
Experienced in low-level programming to maximize performance for AI operations, leveraging tools like Compute Kernel (CK) and/or CUTLASS for multi-GPU and multi-platform performance
Experience using profiling and benchmark tooling for large models
Excellent problem-solving skills and attention to detail
Strong communication and teamwork skills
PhD in Computer Science, Computational Science, Computer Engineering, Electrical Engineering, or a related field
Preferred
Experience in C++23/26
Experience with model optimization, such as low-precision quantization (MXFP4, FP8, INT4)
Experience with AI software frameworks, such as PyTorch, vLLM, SGLang, etc
Knowledge of model architectures, LLMs, MoE, and diffusion
Knowledge of AMD architectures (GCN, RDNA, CDNA)
Experience in running large-scale HPC workloads on heterogeneous compute clusters, optimizing for efficiency and scalability
Knowledge of compiler theory and tools like LLVM and ROCm for kernel and system performance optimization
Benefits
AMD benefits at a glance.
Company
AMD
Advanced Micro Devices is a semiconductor company that designs and develops graphics units, processors, and media solutions.
Founded in 1969
10001+ employees
H1B Sponsorship
AMD has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (836)
2024 (770)
2023 (551)
2022 (739)
2021 (519)
2020 (547)
Funding
Current Stage
Public CompanyTotal Funding
unknownKey Investors
OpenAIDaniel Loeb
2025-10-06Post Ipo Equity
2023-03-02Post Ipo Equity
2021-06-29Post Ipo Equity
Leadership Team
Lisa Su
Chair & CEO
Mark Papermaster
CTO and EVP
Recent News
2026-01-14
2026-01-13
Morningstar.com
2026-01-11
Company data provided by crunchbase