Software Development Manager, AI Inference Technology, Neuron SDK jobs in United States
cer-icon
Apply on Employer Site
company-logo

Amazon Web Services (AWS) · 2 weeks ago

Software Development Manager, AI Inference Technology, Neuron SDK

positionSeattle, WA
timeFull-time
remoteOnsite
seniorityDirector/Executive
money$166K/yr - $288K/yr
date7+ years exp

Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuously innovating. They are seeking a Software Development Manager for the Neuron Inference Technology team to guide AI engineers in developing fundamental inference technology and libraries for optimizing models on Trainium and Inferentia devices.

Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
check
H1B Sponsor Likelynote

Responsibilities

Guide your expert AI engineers to build fundamental inference technology building blocks and libraries to enable AI developers to optimize model for inference on Trainium and Inferentia devices
Develop and optimize blocks such as attention kernels and deliver them in the Neuronx_Distributed Inference Libraries, enabling customers to optimize LLMs, multimodal, and generative models
Work with your senior management and technical leaders to define the building blocks for the latest LLMs, build and deliver them to customers
Manage changing priorities as new models and new technologies emerge, and you adapt your team’s work to manage them
Dive deep to help your team solve technical challenges

Qualification

Engineering team managementDesigning systemsOptimizing LLMsCommunicating with usersRecruitingMentoring

Required

3+ years of engineering team management experience
7+ years of working directly within engineering teams experience
3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
Experience partnering with product or program management teams

Preferred

Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers

Benefits

Equity
Sign-on payments
Medical
Financial
Other benefits

Company

Amazon Web Services (AWS)

twittertwittertwitter
Glassdoor3.8
company-logo
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
dateFounded in 2002
location
Seattle, Washington, USA
people-size10001+ employees
web-link
http://aws.amazon.com

H1B Sponsorship

Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)

Funding

Current Stage
Late Stage
Total Funding
unknown
Key Investors
BIRD Foundation
2025-01-22Grant

Leadership Team

leader-logo
Matt Garman
Chief Executive Officer
linkedin
leader-logo
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
linkedin

Recent News

GlobeNewswire
WellSpan Health Announces Comprehensive Migration of Technology Portfolio to AWS
2026-01-09
Business Wire
Bloomreach’s AI-Powered Marketing Automation and Ecommerce Search Now Available on AWS Marketplace
2026-01-08
thefly.com
Infosys partners with AWS on enterprise adoption of generative AI
2026-01-08
Company data provided by crunchbase