Amazon Web Services (AWS) ยท 1 day ago
Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs
Cupertino, CA
Full-time
Onsite
Senior Level
$151K/yr - $262K/yr
5+ years expAmazon Web Services (AWS) is a leading cloud platform, and they are seeking a Sr. ML Kernel Performance Engineer to work on cutting-edge products at the intersection of machine learning and high-performance computing. The role involves designing and implementing high-performance compute kernels for ML operations and collaborating with various teams to optimize machine learning workloads for customers.
Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
Work directly with customers to enable and optimize their ML models on AWS accelerators
Collaborate across teams to develop innovative kernel optimization techniques
Qualification
Required
5+ years of non-internship professional software development experience
5+ years of programming with at least one software programming language experience
5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Experience as a mentor, tech lead or leading an engineering team
Preferred
Bachelor's degree in computer science or equivalent
6+ years of full software development experience
Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures
Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm
Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA
Experience developing high performance libraries for HPC applications
Proficiency in low-level performance optimization for GPUs
Experience with LLVM/MLIR backend development for GPUs
Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends
Experience with parallel programming and optimization techniques
Understanding of GPU memory hierarchies and optimization strategies
Benefits
Equity
Sign-on payments
Medical
Financial
Other benefits
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
10001+ employees
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Matt Garman
Chief Executive Officer
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
Recent News
2026-01-09
2026-01-09
2026-01-09
Company data provided by crunchbase