Apply on Employer Site

Advanced Microdevices Pvt. Ltd. (India) · 9 hours ago

Principal Engineer Inference Stack

Santa Clara, CA

Full-time

Hybrid

Lead/Staff

Advanced Micro Devices, Inc is dedicated to building innovative products that enhance computing experiences across various domains. They are seeking a Principal Engineer for the Inference Stack, responsible for optimizing applications and benchmarks, leading software engineering efforts, and collaborating with various teams to drive performance improvements.

BiopharmaBiotechnologyIndustrialManufacturing

No H1B

Responsibilities

Develop techniques for optimizing scale-up and scale-out inference

Develop methods and tooling to utilize dynamic resources in service of inference

Support proliferation of rocm ecosystem

Qualification

K8s ecosystem expertiseInference optimization techniquesHigh quality codeGo programmingPython programmingModern concurrent programmingTechnical roadmappingEffective communicationLeadership skillsAttention to detail

Required

Passionate about software engineering and possess leadership skills to drive sophisticated issues to resolution

Able to communicate effectively and work optimally with different teams across AMD

Develop techniques for optimizing scale-up and scale-out inference

Develop methods and tooling to utilize dynamic resources in service of inference

Support proliferation of rocm ecosystem

Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

Preferred

Expertise in the K8s ecosystem, especially as it pertains to large scale inference

Operational experience with at least one of sglang, or vllm and with kserve, llm-d. Experience running inference as a service can be substituted in-lieu of experience with frameworks such as kserve or llm-d

Expertise with techniques used to optimize inference like distributed kv-cache, disaggregation, request scheduling etc

Ability to write high quality code with a keen attention to detail. Preferred languages are go and python

Experience with modern concurrent programming

Effective communicator with keen attention to detail

Prior experience roadmapping deeply technical areas is highly valuable

Benefits

AMD benefits at a glance.

Company

Advanced Microdevices Pvt. Ltd. (India)

Advanced Microdevices (mdi) is a leader in innovative membrane technologies.

Founded in 1976

Ambala, Haryana, IND

501-1000 employees

https://mdimembrane.com

Funding

Current Stage

Late Stage

Leadership Team

Nalini Kant Gupta

Founder & Managing Director

Recent News

The Motley Fool

Lisa Su Just Delivered Incredible News for Advanced Micro Devices Stock Investors

2024-10-18

TradingView

What's Going On With Advanced Micro Devices Stock Tuesday?

2024-10-16

Company data provided by crunchbase