Samsung Electronics · 12 hours ago
Senior Engineer, AI Systems
San Jose, CA
Full-time
Onsite
Mid, Senior Level
$138K/yr - $206K/yr
3+ years expSamsung Electronics is a global leader in technology solutions, and they are seeking a Senior AI Systems Engineer to join their AGI Computing Lab. This role involves designing, analyzing, and optimizing high-performance Triton kernels for large scale LLM inference and training pipelines, collaborating closely with hardware architects and ML researchers.
Consumer ElectronicsElectronicsManufacturingMobile AppsMobile Devices
Responsibilities
Design, implement, and optimize high-performance Triton kernels for LLM workloads on existing accelerators
Analyze kernel performance using profiling tools; interpret metrics such as latency, throughput, occupancy, memory bandwidth, and compute utilization
Identify performance bottlenecks in kernel design (e.g., memory access patterns, synchronization, tiling strategies) and propose concrete optimizations
Work across the stack; from model architecture to kernel implementation—to ensure end-to-end performance efficiency
Collaborate with hardware and compiler teams on hardware–software co-design, providing feedback that influences future accelerator and DSL designs
Prototype and evaluate kernel optimizations using upcoming DSLs and experimental compiler flows
Contribute to the evolution of a Triton-based software stack used for cutting-edge research and production-grade experimentation
Document design decisions, performance trade-offs, and optimization strategies clearly for internal and external stakeholders
Qualification
Required
Bachelor's with 5+ years, or Master's with 3+ years, or PhD's with 0+ years of industry experience
Strong experience writing high-performance Triton kernels for GPUs or other accelerators
Solid understanding of LLM fundamentals, including attention mechanisms, transformer architectures, and inference/training workflows
Deep knowledge of accelerator hardware architecture, including: Memory hierarchies (HBM, SRAM, caches)
Proven ability to read and interpret profiling data and performance counters
Experience diagnosing and resolving performance bottlenecks in kernel-level code
Strong systems programming skills in Python and low-level performance-oriented programming paradigms
Experience with hardware–software co-design or compiler-assisted optimization
Familiarity with FlashAttention, fused kernels, MoE kernels, and different attention mechanisms
Experience working with emerging or experimental domain-specific languages (DSLs) for accelerator programming
Background in ML systems, compilers, or performance engineering
Prior experience working with different accelerator backends (including but not limited to CUDA)
Ability to work effectively in cross-functional, research-oriented environments
Strong analytical and problem-solving skills
You're inclusive, adapting your style to the situation and diverse global norms of our people
An avid learner, you approach challenges with curiosity and resilience, seeking data to help build understanding
You're collaborative, building relationships, humbly offering support and openly welcoming approaches
Innovative and creative, you proactively explore new ideas and adapt quickly to change
Benefits
Medical/Dental/Vision/401k
Charitable giving match
4+ weeks of paid time off a year
Stipend for fertility care or adoption
Medical travel support
Virtual vet care for your fur babies
On-demand apps and free confidential therapy sessions
Onsite Café and gym
Virtual classes
Flexible environment
Company
Samsung Electronics
Samsung Electronics is a technology company that engages in consumer electronics, IT and mobile communications, and device solutions.
10001+ employees
H1B Sponsorship
Samsung Electronics has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (206)
2024 (143)
2023 (234)
2022 (169)
2021 (144)
2020 (144)
Funding
Current Stage
Public CompanyTotal Funding
$4.75BKey Investors
U.S. Department of Commerce
2024-04-15Grant· $4.75B
2023-01-10Post Ipo Equity
1975-06-11IPO
Leadership Team
Jong Hee Han
Vice Chairman & CEO
Ki Nam Kim
Vice Chairman and CEO
Recent News
2026-01-25
2026-01-25
Company data provided by crunchbase