d-Matrix · 1 week ago
Software Engineer, Staff - SIMD Kernels
Santa Clara
Full-time
Hybrid
Senior Level, Lead/Staff
$190K/yr - $300K/yr
7+ years expd-Matrix is focused on unleashing the potential of generative AI to transform technology. They are seeking a Software Engineer, Staff - SIMD Kernels to develop and maintain software kernels for next-generation AI hardware, requiring strong expertise in hardware architectures and software development.
Artificial Intelligence (AI)Cloud InfrastructureData CenterSemiconductor
Responsibilities
The role requires you to be part of the team that helps productize the SW stack for our AI compute engine
As part of the Software team, you will be responsible for the development, enhancement, and maintenance of software kernels for next-generation AI hardware
You possess experience building software kernels for HW architectures
You possess a very strong understanding of various hardware architectures and how to map algorithms to the architecture
You understand how to map computational graphs generated by AI frameworks to the underlying architecture
You have had past experience working across all aspects of the full stack tool chain and understand the nuances of what it takes to optimize and trade-off various aspects of hardware-software co-design
You are able to build and scale software deliverables in a tight development window
You will work with a team of compiler experts to build out the compiler infrastructure working closely with other software (ML, Systems) and hardware (mixed signal, DSP, CPU) experts in the company
Qualification
Required
MS or PhD in computer engineering, math, physics, or a related degree with 7+ years of industry experience
Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
Proficient in C/C++ and Python development in Linux environment and using standard development tools
Experience implementing algorithms in high-level languages such as C/C++ and Python
Experience implementing algorithms for specialized hardware such as FPGAs, DSPs, GPUs, AI accelerators using libraries such as CUDA, etc
Experience in implementing operators commonly used in ML workloads—GEMMs, Convolutions, BLAS, SIMD operators for operations like softmax, layer normalization, pooling, etc
Experience with development for embedded SIMD vector processors such as Tensilica
Self-motivated team player with a strong sense of ownership and leadership
Preferred
Prior startup, small team, or incubation experience
Experience with ML frameworks such as TensorFlow and/or PyTorch
Experience working with ML compilers and algorithms, such as MLIR, LLVM, TVM, Glow, etc
Experience with a deep learning framework (such as PyTorch or TensorFlow) and ML models for CV, NLP, or recommendation
Work experience at a cloud provider or AI compute/subsystem company
Company
d-Matrix
D-Matrix is a platform that enables data centers to handle large-scale generative AI inference with high throughput and low latency.
51-200 employees
H1B Sponsorship
d-Matrix has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (20)
2024 (15)
2023 (8)
2022 (7)
Funding
Current Stage
Growth StageTotal Funding
$429MKey Investors
Temasek HoldingsTSVC
2025-11-12Series C· $275M
2023-09-06Series B· $110M
2022-04-20Series A· $44M
Leadership Team
Peter Buckingham
Senior Vice President, Software Engineering
Recent News
2025-12-22
2025-12-17
Crunchbase News
2025-12-10
Company data provided by crunchbase