Apply on Employer Site

Amazon · 5 months ago

Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Cupertino, California, USA

Full-time

Onsite

Senior Level

$151K/yr - $262K/yr

5+ years exp

Amazon, through its Annapurna Labs team, is seeking a Sr. ML Kernel Performance Engineer for AWS Neuron to enhance deep learning and GenAI workloads on custom machine learning accelerators. The role involves designing high-performance kernels, optimizing performance across hardware generations, and collaborating with customers to ensure optimal machine learning workloads on AWS accelerators.

Artificial Intelligence (AI)DeliveryE-CommerceFoundational AIRetail

No H1B

U.S. Citizen Only

Responsibilities

Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models

Analyze and optimize kernel-level performance across multiple generations of Neuron hardware

Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks

Implement compiler optimizations such as fusion, sharding, tiling, and scheduling

Work directly with customers to enable and optimize their ML models on AWS accelerators

Collaborate across teams to develop innovative kernel optimization techniques

Qualification

ML kernel optimizationGPU programmingHPC architecturesPerformance analysisSoftware development lifecycleProgramming languagesParallel programmingMentorshipTeam collaboration

Required

5+ years of non-internship professional software development experience

5+ years of programming with at least one software programming language experience

5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience

5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

Experience as a mentor, tech lead or leading an engineering team