Ampere · 6 days ago
AI Accelerator Software Engineer-Graph Optimization
Santa Clara, CA
Part-time
Onsite
Senior Level, Lead/Staff
$170K/yr - $282K/yr
8+ years expAmpere is a semiconductor design company leading the future of computing with an innovative approach to CPU design. In this role as an AI Accelerator Software Engineer-Graph Optimization, you will drive the development and optimization of cutting-edge AI frameworks and collaborate with cross-functional teams to enhance AI capabilities for high-performance computing solutions.
Cloud ComputingCloud Data ServicesHardwareSemiconductor
Responsibilities
Optimize the computational graph to fully unlock the potentials of Ampere’s deep learning accelerator
Go deep into to the entire SW/HW stack to accelerate the deep learning including but not limited to inference serving, framework integration, compiler, runtime library, communication and compute kernel development, and performance tuning
Work on deep learning model enabling with performance and accuracy for popular frameworks like PyTorch and Llama.cpp and for serving platforms like vLLM and SGLang, positioning you at the forefront of AI innovation
HW/SW codesign to optimize existing AI architectures to enhance computational efficiency, increase throughput, reduce latency, and improve the scalability, pushing the boundaries of what's possible in AI technology
Be a key team member in building state-of-the-art software and hardware AI co-processors/accelerators, contribute to a collaborative and dynamic work environment, supporting continuous improvement and excellence
Collaborate with cross-functional teams to integrate AI solutions into Ampere's cloud-native processor platforms and accelerators
Qualification
Required
BS Computer Science, Mathematics or a related technical field & 12 years of related experience; or MS degree & 8 years; or PhD & 5 years
Previous development experience with LLVM/MLIR/XLA for deep learning
Strong expertise in programming languages such as Python, C/C++ with a strong background in performance tuning
Deep knowledge of Graph IR, such as Torch FX Graph IR, MLIR Dialects, etc
Experience with pattern recognition and fusion strategies
Preferred
Solid understanding of AI and machine learning concepts, including neural networks and data processing frameworks
Benefits
Premium medical insurance, dental insurance, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future.
Unlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance.
A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day.
Company
Ampere
Ampere is a modern semiconductor company designing the future of hyperscale cloud and edge computing with the world’s first Cloud Native Processors.
1001-5000 employees
H1B Sponsorship
Ampere has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (52)
2024 (50)
2023 (61)
2022 (56)
2021 (52)
2020 (30)
Funding
Current Stage
Late StageTotal Funding
$813.8MKey Investors
OracleThe Carlyle Group
2025-03-20Acquired
2022-04-01Secondary Market· $127.8M
2022-04-01Convertible Note· $300M
Leadership Team
Renee James
Founder, Chairman & CEO
Adam Young
Senior Principal Software Engineer
Recent News
2026-01-06
The top 10 AI stories of 2025 | CIO
2026-01-03
Crunchbase News
2025-12-31
Company data provided by crunchbase