Etched · 10 hours ago
Inference Software Engineer
San Jose, CA
Full-time
Onsite
Mid Level
$175K/yr - $275K/yrEtched is building the world’s first AI inference system purpose-built for transformers, delivering significantly higher performance and lower costs. They are seeking an Inference Software Engineer to support model porting, enhance runtime scalability, and optimize communication layers.
AI InfrastructureArtificial Intelligence (AI)ComputerHardwareSemiconductor
Responsibilities
Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting
Build, enhance, and scale Sohu’s runtime, including multi-node inference, intra-node execution, state management, and robust error handling
Optimize routing and communication layers using Sohu’s collectives
Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues
Qualification
Required
Proficiency in C++ or Rust
Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand)
Familiarity with PyTorch or JAX
Ported applications to non-standard accelerator hardware or hardware platforms
Preferred
Developed low-latency, high-performance applications using both kernel-level and user-space networking stacks
Deep understanding of distributed systems concepts, algorithms, and challenges, including consensus protocols, consistency models, and communication patterns
Solid grasp of Transformer architectures, particularly Mixture-of-Experts (MoE)
Built applications with extensive SIMD (Single Instruction, Multiple Data) optimizations for performance-critical paths
Benefits
Full medical, dental, and vision packages, with generous premium coverage
Housing subsidy of $2,000/month for those living within walking distance of the office
Daily lunch and dinner in our office
Relocation support for those moving to West San Jose
Company
Etched
Building the hardware for superintelligence
Founded in 2022
51-200 employees
H1B Sponsorship
Etched has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (9)
2024 (11)
2023 (1)
Funding
Current Stage
Growth StageTotal Funding
$625.36MKey Investors
StripesPrimary Venture Partners
2026-01-14Series Unknown· $500M
2024-06-25Series A· $120M
2023-05-16Seed· $5.36M
Leadership Team
Chris Zhu
Co-Founder
Robert Wachen
Co-Founder and President
Recent News
2026-01-16
2026-01-16
Soma Capital
2026-01-07
Company data provided by crunchbase