d-Matrix · 6 months ago
AI / ML System Software Engineer, Senior Staff
Santa Clara, CA
Full-time
Hybrid
Senior Level, Lead/Staff
8+ years expd-Matrix is focused on unleashing the potential of generative AI to power the transformation of technology. They are seeking a Senior Staff AI/ML System Software Engineer to help productize the software stack for their AI compute engine and develop next-generation AI deployment software.
AI InfrastructureArtificial Intelligence (AI)Cloud InfrastructureData CenterSemiconductor
Responsibilities
You will be responsible for the development, enhancement, and maintenance of the next-generation AI deployment software
You are able to build and scale software deliverables in a tight development window
You will work with a team of compiler experts to build out the compiler infrastructure, working closely with other software (ML, systems) and hardware (mixed signal, DSP, CPU) experts in the company
Qualification
Required
BS in Computer Science, Engineering, Math, Physics or related degree with 8+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics or related degree preferred with 5 + years
Strong grasp of computer architecture, data structures, system software, and machine learning fundamentals
Proficient in C/C++/Python development in Linux environment and using standard development tools
Experience with distributed, high performance software design and implementation
Self-motivated team player with a strong sense of ownership and leadership
Preferred
MS or PhD in Computer Science, Electrical Engineering, or related fields
Prior startup, small team, or incubation experience
Work experience at a cloud provider or AI compute/subsystem company
Experience implementing SIMD algorithms on vector processors
Experience with open-source ML compiler frameworks such as MLIR
Experience with deep learning frameworks (such as PyTorch and TensorFlow)
Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, ...)
Experience with inference servers/model serving frameworks (such as Triton, TFServ, KubeFlow, …)
Experience with distributed systems collectives such as NCCL and OpenMPI
Experience deploying ML workloads on distributed systems in a multitenancy environment
Experience with MLOps from definition to deployment, including training, quantization, sparsity, model preprocessing, and deployment
Experience training, tuning, and deploying ML models for CV (ResNet), NLP (BERT, GPT), and/or recommendation systems (DLRM)
Company
d-Matrix
D-Matrix is a platform that enables data centers to handle large-scale generative AI inference with high throughput and low latency.
51-200 employees
H1B Sponsorship
d-Matrix has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (20)
2024 (15)
2023 (8)
2022 (7)
Funding
Current Stage
Growth StageTotal Funding
$429MKey Investors
Temasek HoldingsTSVC
2025-11-12Series C· $275M
2023-09-06Series B· $110M
2022-04-20Series A· $44M
Leadership Team
Peter Buckingham
Senior Vice President, Software Engineering
Recent News
2025-12-22
2025-12-17
Crunchbase News
2025-12-10
Company data provided by crunchbase