Sr. SDM, AI Inference Technology, Neuron SDK jobs in United States
cer-icon
Apply on Employer Site
company-logo

Amazon Web Services (AWS) · 18 hours ago

Sr. SDM, AI Inference Technology, Neuron SDK

Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, and they are seeking a Senior Software Development Manager for the Inference Technology Team. The role involves leading a team to develop fundamental inference technology and libraries for AI developers optimizing models on Trainium and Inferentia devices.

Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
check
H1B Sponsor Likelynote

Responsibilities

Lead a strong team of managers and engineers to build fundamental inference technology building blocks and libraries to enable AI developers to optimize model for inference on Trainium and Inferentia devices
Be responsible for the full development life cycle of inference library and feature development, including reliability and scalability
Develop the Neuronx_Distributed Inference Libraries and contribute to other popular open source Inference Libraries, enabling customers to optimize LLMs, multimodal, and generative models
Work with the executive leadership and other senior management and technical leaders to define product directions and deliver them to customers

Qualification

Engineering managementDistributed inference librariesLarge scale applicationsAgile environmentConsumer software developmentProduct management partnershipTeam collaboration

Required

10+ years of engineering experience
5+ years of engineering team management experience
10+ years of planning, designing, developing and delivering consumer software experience
Experience partnering with product or program management teams
Experience managing multiple concurrent programs, projects and development teams in an Agile environment

Preferred

Experience partnering with product and program management teams
Experience designing and developing large scale, high-traffic applications

Benefits

Equity
Sign-on payments
Medical
Financial
Other benefits

Company

Amazon Web Services (AWS)

company-logo
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.

H1B Sponsorship

Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)

Funding

Current Stage
Late Stage
Total Funding
unknown
Key Investors
BIRD Foundation
2025-01-22Grant

Leadership Team

leader-logo
Matt Garman
Chief Executive Officer
linkedin
leader-logo
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
linkedin
Company data provided by crunchbase