d-Matrix · 3 days ago
Software Engineer, Senior Staff - Kernels
Santa Clara, CA
Full-time
Hybrid
Senior Level, Lead/Staff
10+ years expd-Matrix is focused on unleashing the potential of generative AI to power the transformation of technology. The role involves productizing the software stack for their AI compute engine, with responsibilities including the development and maintenance of software kernels for next-generation AI hardware.
AI InfrastructureArtificial Intelligence (AI)Cloud InfrastructureData CenterSemiconductor
Responsibilities
The role requires you to be part of the team that helps productize the SW stack for our AI compute engine
As part of the software team, you will be responsible for the development, enhancement, and maintenance of software kernels for next-generation AI hardware
You possess experience building software kernels for HW architectures
You possess a very strong understanding of various hardware architectures and how to map algorithms to the architecture
You understand how to map computational graphs generated by AI frameworks to the underlying architecture
You have had past experience working across all aspects of the full-stack toolchain and understand the nuances of what it takes to optimize and trade off various aspects of hardware-software co-design
You can build and scale software deliverables in a tight development window
You will work with a team of compiler experts to build out the compiler infrastructure, working closely with other software (ML, systems) and hardware (mixed signal, DSP, CPU) experts in the company
Qualification
Required
MS in computer engineering, math, physics, or a related degree with 10+ years of industry experience or PhD in computer engineering, math, physics, or a related degree with 1+ years of industry experience
Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
Proficient in C/C++ and Python development in Linux environments and using standard development tools
Experience implementing algorithms in high-level languages such as C/C++ and Python
Experience implementing algorithms for specialized hardware such as FPGAs, DSPs, GPUs, and AI accelerators using libraries such as CUDA, etc
Experience in implementing operators commonly used in ML workloads—GEMMs, Convolutions, BLAS, SIMD operators for operations like softmax, layer normalization, pooling, etc
Experience with development for embedded SIMD vector processors such as Tensilica
Self-motivated team player with a strong sense of ownership and leadership
Preferred
Prior startup, small team, or incubation experience
Experience with ML frameworks such as TensorFlow and/or PyTorch
Experience working with ML compilers and algorithms, such as MLIR, LLVM, TVM, Glow, etc
Experience with a deep learning framework (such as PyTorch or TensorFlow) and ML models for CV, NLP, or recommendation
Work experience at a cloud provider or AI compute/subsystem company
Company
d-Matrix
D-Matrix is a platform that enables data centers to handle large-scale generative AI inference with high throughput and low latency.
51-200 employees
H1B Sponsorship
d-Matrix has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (20)
2024 (15)
2023 (8)
2022 (7)
Funding
Current Stage
Growth StageTotal Funding
$429MKey Investors
Temasek HoldingsTSVC
2025-11-12Series C· $275M
2023-09-06Series B· $110M
2022-04-20Series A· $44M
Leadership Team
Peter Buckingham
Senior Vice President, Software Engineering
Recent News
2025-12-22
2025-12-17
Crunchbase News
2025-12-10
Company data provided by crunchbase