Samsung Semiconductor · 17 hours ago
Senior Engineer, AI Systems
San Jose, California, United States
Full-time
Onsite
Mid, Senior Level
$138K/yr - $206K/yr
3+ years expSamsung Semiconductor is a global leader in technology solutions, and they are seeking a Senior AI Systems Engineer to join their AGI Computing Lab. This role involves designing and optimizing high-performance Triton kernels for AI workloads, collaborating with hardware and software teams to enhance performance and efficiency.
Semiconductor
Responsibilities
Design, implement, and optimize high-performance Triton kernels for LLM workloads on existing accelerators
Analyze kernel performance using profiling tools; interpret metrics such as latency, throughput, occupancy, memory bandwidth, and compute utilization
Identify performance bottlenecks in kernel design (e.g., memory access patterns, synchronization, tiling strategies) and propose concrete optimizations
Work across the stack; from model architecture to kernel implementation—to ensure end-to-end performance efficiency
Collaborate with hardware and compiler teams on hardware–software co-design, providing feedback that influences future accelerator and DSL designs
Prototype and evaluate kernel optimizations using upcoming DSLs and experimental compiler flows
Contribute to the evolution of a Triton-based software stack used for cutting-edge research and production-grade experimentation
Document design decisions, performance trade-offs, and optimization strategies clearly for internal and external stakeholders
Qualification
Required
Bachelor's with 5+ years, or Master's with 3+ years, or PhD's with 0+ years of industry experience
Strong experience writing high-performance Triton kernels for GPUs or other accelerators
Solid understanding of LLM fundamentals, including attention mechanisms, transformer architectures, and inference/training workflows
Deep knowledge of accelerator hardware architecture, including: Memory hierarchies (HBM, SRAM, caches)
Proven ability to read and interpret profiling data and performance counters
Experience diagnosing and resolving performance bottlenecks in kernel-level code
Strong systems programming skills in Python and low-level performance-oriented programming paradigms
Experience with hardware–software co-design or compiler-assisted optimization
Familiarity with FlashAttention, fused kernels, MoE kernels, and different attention mechanisms
Experience working with emerging or experimental domain-specific languages (DSLs) for accelerator programming
Background in ML systems, compilers, or performance engineering
Prior experience working with different accelerator backends (including but not limited to CUDA)
Ability to work effectively in cross-functional, research-oriented environments
Strong analytical and problem-solving skills
You're inclusive, adapting your style to the situation and diverse global norms of our people
An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding
You're collaborative, building relationships, humbly offering support and openly welcoming approaches
Innovative and creative, you proactively explore new ideas and adapt quickly to change
Benefits
Medical/Dental/Vision/401k
Charitable giving match
Paid time off a year
Stipend for fertility care or adoption
Medical travel support
Virtual vet care
On-demand apps and free confidential therapy sessions
Onsite Café and gym
Virtual classes
Flexible environment
Company
Samsung Semiconductor
Samsung Semiconductor, Inc. (SSI) is a multi-billion dollar wide range of industry-leading semiconductor solutions.
Founded in 1974San Jose, California, USA
10001+ employees
H1B Sponsorship
Samsung Semiconductor has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (130)
2024 (110)
2023 (153)
2022 (134)
2021 (124)
2020 (134)
Funding
Current Stage
Late StageLeadership Team
Daehee Lee
Principal Engineer
Eric Hibbard
Director, Product Planning – Security
Recent News
Android Authority
2025-12-22
2025-11-07
PhAndroid.com
2025-11-07
Company data provided by crunchbase