Samsung Semiconductor · 12 hours ago
Staff Engineer, AI System Architect (Hardware)
San Jose, California, United States
Full-time
Onsite
Senior Level, Lead/Staff
$163K/yr - $253K/yr
5+ years expSamsung Semiconductor is a global leader in technology solutions that power everyday tools. They are seeking a Senior Staff AI System Architect to conduct architectural research for next-generation AI systems, develop performance models, and drive design decisions to enhance AI system architectures.
Semiconductor
Responsibilities
Conduct system-level architectural research for next-generation AI systems, spanning compute, memory, and interconnect/network subsystems
Develop and maintain analytical and simulation-based system modeling frameworks to evaluate AI workloads and identify performance, scalability, and efficiency bottlenecks at rack- and system-scale
Analyze representative and emerging AI workloads (e.g., LLMs, DLRMs, and future AI models) to derive architecture requirements and trade-offs across compute, memory, networking, and power
Drive architecture-level design decisions through quantitative modeling, design-space exploration, and performance/power projections
Perform comparative studies of alternative system architectures, reporting performance and performance-per-watt metrics to guide strategic technology choices
Collaborate closely with cross-functional teams in hardware architecture, memory, interconnect, and system engineering to align modeling insights with implementation realities
Communicate architectural insights and recommendations through clear technical presentations and documentation
Occasional domestic and international travel (<10%)
Qualification
Required
Ph.D. in Computer Science, Electrical Engineering, or a related field, with 5+ years of experience in system architecture for large-scale computing platforms, with a strong focus on AI workloads
Proven hands-on experience developing analytical and event-driven simulation models for system-level performance evaluation
Deep understanding of AI system hardware architectures, including compute, memory hierarchies, and high-performance interconnects
Strong knowledge of modern and emerging AI workloads, including LLMs, DLRMs, and large-scale training and inference systems
Demonstrated ability to translate workload characteristics and modeling results into actionable architectural design decisions
Proficiency in Python, C++, and PyTorch for modeling, analysis, and experimentation
Excellent written, verbal, and presentation communication skills, with the ability to influence technical direction across teams
A collaborative mindset, intellectual curiosity, and resilience in tackling complex, open-ended system-level challenges
Benefits
Medical/Dental/Vision/401k
Charitable giving match
4+ weeks of paid time off a year
Stipend for fertility care or adoption
Medical travel support
Virtual vet care for your fur babies
On-demand apps and free confidential therapy sessions
Onsite Café and gym
Virtual classes
Flexible environment
Company
Samsung Semiconductor
Samsung Semiconductor, Inc. (SSI) is a multi-billion dollar wide range of industry-leading semiconductor solutions.
Founded in 1974San Jose, California, USA
10001+ employees
H1B Sponsorship
Samsung Semiconductor has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (130)
2024 (110)
2023 (153)
2022 (134)
2021 (124)
2020 (134)
Funding
Current Stage
Late StageLeadership Team
Daehee Lee
Principal Engineer
Eric Hibbard
Director, Product Planning – Security
Recent News
Android Authority
2025-12-22
2025-11-07
PhAndroid.com
2025-11-07
Company data provided by crunchbase