Amazon Web Services (AWS) · 10 hours ago
Software Development Manager, LLM Inference Model Enablement, Neuron SDK
Cupertino, CA
Full-time
Onsite
Director/Executive
$166K/yr - $288K/yr
7+ years expAmazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. As the Software Development Manager for the LLM Inference Model Enablement team, you will lead a team of expert AI/ML engineers to optimize state-of-the-art LLMs for inference on Neuron and Trainium accelerators, driving improvements in model enablement speed and quality.
Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Lead a team of expert AI/ML engineers to onboard and optimize state-of-the-art open-source and customer LLMs for inference on Neuron and Trainium and Inferentia accelerators
Drive improvements in model enablement speed and experience, while advancing inference usability and quality through inference features, infrastructure optimization, tools, and automation
Work with senior management and technical leaders to define the model enablement and performance optimization for the latest SOTA LLMs, build and deliver them to customers
Manage changing priorities as new models and new technologies emerge, and adapt the team’s work to manage them
Dive deep to help your team solve technical challenges
Qualification
Required
3+ years of engineering team management experience
7+ years of working directly within engineering teams experience
3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
Experience partnering with product or program management teams
Preferred
Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers
Benefits
Equity
Sign-on payments
Full range of medical, financial, and/or other benefits
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
10001+ employees
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Matt Garman
Chief Executive Officer
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
Recent News
Small Business Trends
2026-01-12
Thailand Business News
2026-01-12
Company data provided by crunchbase