Amazon Web Services (AWS) · 1 day ago
Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference
Seattle, WA
Full-time
Onsite
Senior Level
$151K/yr - $262K/yr
5+ years expAmazon Web Services (AWS) is looking for a Senior Software Development Engineer to join the Annapurna Labs team, which builds the AWS Neuron SDK for accelerating deep learning and GenAI workloads. The role involves architecting and implementing critical features, mentoring engineers, and optimizing machine learning models for AWS's custom accelerators while collaborating with cross-functional teams.
ConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Would with state of the art LLMs, Open source and internal LLM families, large scale performance and benchmark evaluations etc
Develop and performance tune a wide variety of LLM model families, including 500B+ large language models like the Llama family, DeepSeek and beyond
Work side by side with performance, compiler and runtime engineers to create, build and tune distributed inference solutions with Trainium and Inferentia
Build infrastructure to systematically analyze and onboard multiple models with diverse architecture
Collaborate with performance team to enable and evaluate optimizations such as fusion, sharding, tiling, and scheduling etc
Conduct comprehensive testing, including unit and end-to-end model testing with continuous deployment and releases through pipelines
Work directly with customers to enable and optimize their ML models on AWS accelerators
Collaborate across teams to develop innovative optimization techniques
Build online/offline inference serving with vLLM, SGLang, TensorRT or similar platforms in production environments
Qualification
Required
5+ years of non-internship professional software development experience
5+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Fundamentals of Machine learning and LLMs, their architecture, training and inference lifecycles along with work experience on some optimizations for improving the model execution
Experience programming with at least one software programming language
Preferred
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Masters degree in computer science or equivalent
Benefits
Equity
Sign-on payments
Full range of medical, financial, and/or other benefits
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
10001+ employees
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Matt Garman
Chief Executive Officer
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
Recent News
2026-01-03
2026-01-03
2025-12-31
Company data provided by crunchbase