Apply on Employer Site

Amazon · 4 months ago

Software Engineering Manager, ML Kernel Performance, AWS Neuron, Annapurna Labs

Cupertino, California, USA

Full-time

Onsite

Mid, Senior Level

$166K/yr - $288K/yr

3+ years exp

Annapurna Labs, part of Amazon Web Services (AWS), is focused on accelerating deep learning and GenAI workloads with its AWS Neuron software development kit. The Software Engineering Manager for ML Kernel Performance will lead a team to design and implement high-performance compute kernels for machine learning operations while collaborating across various teams to optimize performance for AWS's custom ML accelerators.

Artificial Intelligence (AI)DeliveryE-CommerceFoundational AIRetail

No H1B

U.S. Citizen Only

Responsibilities

Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models

Analyze and optimize kernel-level performance across multiple generations of Neuron hardware

Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks

Implement compiler optimizations such as fusion, sharding, tiling, and scheduling

Work directly with customers to enable and optimize their ML models on AWS accelerators

Collaborate across teams to develop innovative kernel optimization techniques

Build high-impact solutions to deliver to our large customer base

Participate in design discussions, code review, and communicate with internal and external stakeholders

Work cross-functionally to help drive business decisions with your technical input

Work in a startup-like development environment, where you’re always working on the most important stuff

Qualification

Engineering team managementDesigning systems architectureMulti-tier web servicesSoftware development life cycleProduct management collaborationMentoring software engineersEffective communication

Required

3+ years of engineering team management experience

7+ years of working directly within engineering teams experience

3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience

8+ years of leading the definition and development of multi tier web services experience

Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations

Experience partnering with product or program management teams

Preferred

Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy

Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers