Hardware Design Engineer, AI Inference Engine jobs in United States
cer-icon
Apply on Employer Site
company-logo

ElastixAI · 5 months ago

Hardware Design Engineer, AI Inference Engine

ElastixAI is an early-stage startup focused on revolutionizing AI inference infrastructure. They are seeking a visionary Hardware Design Engineer to contribute to the design and implementation of their core AI inference engine, ensuring it aligns with machine learning strategies and cloud hardware targets.

Artificial Intelligence (AI)Generative AIMachine Learning
check
H1B Sponsor Likelynote

Responsibilities

Contribute to the architectural definition, design, and implementation of a novel AI inference engine optimized for our specific ML workloads
Collaborate closely with ML engineers to understand and influence ML directions
Work hand-in-hand with software engineers to define a seamless hardware-software interface, ensuring the inference engine is highly programmable, efficient, and easy to integrate into our broader software stack and compiler
Partner with cloud engineers to ensure the inference engine architecture aligns with target cloud hardware capabilities, deployment strategies, and performance/cost objectives
Model and analyze the performance, power, and area (PPA) trade-offs of different architectural choices
Stay at the forefront of AI accelerator research, identifying emerging techniques and technologies relevant to our co-design approach
Contribute to the RTL design, simulation, and verification efforts for the inference engine components
Drive the hardware roadmap for the inference engine, anticipating future AI model trends and optimization opportunities
Foster a culture of innovation and technical excellence within a highly interdisciplinary engineering team

Qualification

Hardware design for AI/MLVerilog/SystemVerilogAI/ML model understandingMemory system architectureML optimization techniquesPerformance modeling toolsStartup environment adaptabilityProblem-solving skillsCommunication skillsInterpersonal skills

Required

BS, MS or PhD in Computer Engineering, Electrical Engineering, or a related field
Proven experience (5+ years) in hardware design, with a strong focus on designing/implementing hardware for AI/ML acceleration
Deep understanding of modern AI/ML models, particularly LLMs, and their computational characteristics
Experience with hardware implementation of ML optimization techniques (e.g., sparsity, quantization, pruning)
Proficiency in Verilog or SystemVerilog for RTL design and simulation
Strong understanding of memory system architecture, on-chip interconnects, parallel processing, and distributed computing
Excellent problem-solving skills and the ability to analyze complex systems
Exceptional communication and interpersonal skills, with a demonstrated ability to work effectively in a highly interdisciplinary environment, collaborating with ML, software, and cloud/systems engineers
Ability to thrive in a fast-paced, dynamic startup environment with a strong bias for action/execution

Preferred

Knowledge of compiler technologies for AI models (e.g., MLIR, TVM)
Familiarity with performance modeling and analysis tools
Experience with system-level integration and debugging
Contributions to relevant research publications or open-source projects
Understanding of cloud computing environments and deploying hardware accelerators in the cloud
High-speed inter-chip networking experience

Benefits

Comprehensive medical, dental, and vision coverage (100% paid by employer)
Flexible Time Off (FTO)
Paid parental leave
Company sponsored 401K Plan
Gym or fitness benefit
Commuter benefit
Investment in employee learning & development

Company

ElastixAI

twittertwitter
company-logo
ElastixAI is developing an AI inference platform designed to optimize how large language models are run.

H1B Sponsorship

ElastixAI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)

Funding

Current Stage
Early Stage
Total Funding
$16M
Key Investors
FUSE
2025-05-14Series Unknown· $16M
Company data provided by crunchbase