Principal Engineer Inference Stack jobs in United States
cer-icon
Apply on Employer Site
company-logo

AMD · 18 hours ago

Principal Engineer Inference Stack

positionSanta Clara, CA
timeFull-time
remoteHybrid
seniorityLead/Staff
money$226K/yr - $340K/yr

AMD is a company focused on building innovative products that accelerate next-generation computing experiences. They are seeking a strategic software engineering lead to improve the performance of key applications and benchmarks, working with a talented team and the latest technology.

AI InfrastructureArtificial Intelligence (AI)Cloud ComputingComputerEmbedded SystemsGPUHardwareSemiconductor
check
Growth OpportunitiesbadNo H1Bnote

Responsibilities

Develop techniques for optimizing scale-up and scale-out inference
Develop methods and tooling to utilize dynamic resources in service of inference
Support proliferation of rocm ecosystem

Qualification

K8s ecosystem expertiseInference optimization techniquesHigh quality codeGo programmingPython programmingModern concurrent programmingTechnical roadmappingEffective communicationLeadership skillsAttention to detail

Required

Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

Preferred

Expertise in the K8s ecosystem, especially as it pertains to large scale inference
Operational experience with atleast one of sglang, or vllm and with kserve, llm-d. Experience running inference as a service can be substituted in-lieu of experience with frameworks such as kserve or llm-d
Expertise with techniques used to optimize inference like distributed kv-cache, disaggregation, request scheduling etc
Ability to write high quality code with a keen attention to detail. Preferred languages are go and python
Experience with modern concurrent programming
Effective communicator with keen attention to detail
Prior experience roadmapping deeply technical areas is highly valuable

Benefits

AMD benefits at a glance.

Company

AMD

twittertwittertwitter
Glassdoor4.1
company-logo
Advanced Micro Devices is a semiconductor company that designs and develops graphics units, processors, and media solutions.
dateFounded in 1969
location
Santa Clara, California, USA
people-size10001+ employees
web-link
http://www.amd.com

Funding

Current Stage
Public Company
Total Funding
unknown
Key Investors
OpenAIDaniel Loeb
2025-10-06Post Ipo Equity
2023-03-02Post Ipo Equity
2021-06-29Post Ipo Equity

Leadership Team

leader-logo
Lisa Su
Chair & CEO
linkedin
leader-logo
Mark Papermaster
CTO and EVP
linkedin

Recent News

CRN
AMD CEO On ‘Next Phase Of AI’ Investments In EPYC, Ryzen, GPUs And Partners In 2026
2026-01-23
PCMag.com - Technology Product Reviews, News, Prices & Tips
AMD Ryzen 7 9850X3D Launches on Jan. 29 for $499
2026-01-23
KitGuru.net
AMD confirms Ryzen 7 9850X3D for late January release, $499
2026-01-23
Company data provided by crunchbase