Apply on Employer Site

Advanced Microdevices Pvt. Ltd. (India) · 1 month ago

MTS - Distributed Inferencing Software Engineer - AI Models

Austin, TX

Full-time

Onsite

Mid, Senior Level

Advanced Micro Devices, Inc is a company focused on building innovative products that enhance computing experiences across various domains. They are seeking a Distributed Inferencing Software Engineer who will work on optimizing AI models on distributed systems, collaborating with GPU library teams to enhance performance and scalability.

BiopharmaBiotechnologyIndustrialManufacturing

Responsibilities

Enable, benchmark AI models on distributed systems

Work in a distributed computing setting to optimize for both scale-up (multi-GPU) / scale-out (multi-node) / scale-across systems

Collaborate and interact with internal GPU library teams to analyze and optimize distributed workloads for high throughput/low latency

Expertise on parallelization strategies for AI workloads - and application for best performance for each configuration

Contribute to distributed model management, model zoos, monitoring, benchmarking and documentation

Qualification

C++PythonGPU computingAI framework engineeringDistributed systemsPerformance analysisSLURMK8sDebuggingTest design

Required

Strong technical and analytical skills in C++/Python AI development, solving performance and investigating scalability on multi-GPU, multi-node clusters

Ability to work as part of a team, while also being able to work independently, define goals and scope and lead your own development effort