AMD · 14 hours ago
GPU Performance Software Development Engineer
San Jose, CA
Full-time
Hybrid
Senior Level
$192K/yr - $288K/yrAMD is a company focused on building products that accelerate next-generation computing experiences. The GPU Performance Software Development Engineer will own the performance of Wave’s GPU kernels, optimizing them for peak performance and addressing bottlenecks across various levels of execution.
AI InfrastructureArtificial Intelligence (AI)Cloud ComputingComputerEmbedded SystemsGPUHardwareSemiconductor
Responsibilities
Own kernel performance for Wave
Optimize critical kernels (GEMM, Attention, MoE, decoding) to be competitive with or exceed vendor libraries
Profile, analyze, and eliminate bottlenecks across memory, registers, instruction scheduling, and wave/warp execution
Low-level GPU optimization
Write and tune kernels using HIP / CUDA / inline assembly / intrinsics (e.g., MFMA / MMA)
Optimize LDS/shared memory usage, register allocation, instruction scheduling, occupancy, and wave/warp utilization
Reason about hardware details such as waves/warps, WGP/SM behavior, pipelines, cache hierarchies, and memory systems
Compiler & MLIR integration
Extend and optimize MLIR dialects and lowering pipelines relevant to GPU code generation
Bridge high-level representations (FX / Python DSL) to low-level MLIR and ISA-aware transformations
Implement compiler passes for tiling, vectorization, prefetching, pipelining, and layout transformations
Performance modeling & tooling
Build mental and empirical performance models to guide kernel design
Use profiling tools (e.g., rocprof, Nsight, custom counters) and disassembly to validate hypotheses
Create internal benchmarks, microkernels, and performance regression tests
Architecture bring-up
Lead kernel and compiler optimization for new GPU architectures
Adapt kernels and compiler strategies to evolving hardware capabilities
Qualification
Required
Deep GPU performance expertise
Proven experience optimizing GPU kernels at the instruction and memory-system level
Strong understanding of GPU execution models (waves/warps, occupancy, latency hiding)
Proficiency in C++ and GPU programming (HIP or CUDA)
Experience with GPU intrinsics, inline PTX / GCN assembly, or equivalent low-level code
Hands-on experience with compilers, preferably MLIR
Familiarity with compiler IRs, lowering pipelines, and performance-critical transformations
Ability to read disassembly, analyze performance counters, and reason from first principles
Track record of closing performance gaps against strong baselines
Masters in Computer Science or related field
Preferred
Experience with AMD GPUs (ROCm, CDNA, MI-series) or NVIDIA GPUs (Ampere/Hopper/Blackwell)
Experience designing or maintaining a DSL, compiler backend, or GPU codegen pipeline
Background in linear algebra kernels, attention mechanisms, or ML workloads
Comfort working across Python frontends, MLIR, and backend codegen
PhD in Computer Science or related field
Benefits
AMD benefits at a glance.
Company
AMD
Advanced Micro Devices is a semiconductor company that designs and develops graphics units, processors, and media solutions.
Founded in 1969
10001+ employees
H1B Sponsorship
AMD has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (836)
2024 (770)
2023 (551)
2022 (739)
2021 (519)
2020 (547)
Funding
Current Stage
Public CompanyTotal Funding
unknownKey Investors
OpenAIDaniel Loeb
2025-10-06Post Ipo Equity
2023-03-02Post Ipo Equity
2021-06-29Post Ipo Equity
Leadership Team
Lisa Su
Chair & CEO
Mark Papermaster
CTO and EVP
Recent News
2026-01-20
2026-01-19
2026-01-18
Company data provided by crunchbase