Amazon Web Services (AWS) ยท 1 day ago
Software Engineer-AI/ML, AWS Neuron Inference
Seattle, WA
Full-time
Onsite
Mid, Senior Level
$129K/yr - $224K/yr
3+ years expAmazon Web Services (AWS) is seeking a Senior Software Engineer for the Machine Learning Inference Applications team. This role focuses on the development and optimization of core building blocks for LLM Inference, collaborating with various engineering teams to enhance performance on Neuron devices.
ConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Adapting latest research in LLM optimization to Neuron chips to extract best performance from both open source as well as internally developed models
Working across teams and organizations is key
Qualification
Required
3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Fundamentals of Machine learning models, their architecture, training and inference lifecycles along with work experience on some optimizations for improving the model performance
Preferred
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Hands-on experience with PyTorch or Jax - preferably involving developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
Benefits
Equity
Sign-on payments
Full range of medical, financial, and/or other benefits
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
10001+ employees
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Matt Garman
Chief Executive Officer
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
Recent News
2026-01-07
2026-01-07
2026-01-07
Company data provided by crunchbase