Apply on Employer Site

Google · 3 weeks ago

GPU Performance Engineer

Sunnyvale, CA

Full-time

Onsite

Entry, Mid Level

$141K/yr - $202K/yr

2+ years exp

Google is a leading technology company that develops next-generation technologies impacting billions of users. The GPU Performance Engineer will optimize and evaluate GPU systems for Machine Learning workloads, identifying performance opportunities and driving improvements across Google's GPU software stack.

AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO

Growth Opportunities

H1B Sponsor Likely

Responsibilities

Build improvements for the latest generation of Graphics Processing Unit (GPUs) that power Google’s most critical products and services, impacting billions of users worldwide

Identify performance bottlenecks and drive improvements across the breadth and depth of Google’s GPU software stack from ML compiler cost model design (OpenXLA, Triton, MLIR) to optimizing performance GPU kernels (Pallas Mosaic, CuTe) to cross node model serving configurations (e.g., disaggregated serving, paged attention)

Influence the technical direction of the GPU software ecosystem at Google by collaborating with Modeling, XLA:GPU, Deepmind and Performance Tooling teams. Influence the deployment of Google’s GPU fleet by working with various product teams across Google

Qualification

Low-level GPU programmingModern GPU architecturesCompiler improvementData structuresAlgorithmsLarge Language ModelsSoftware developmentPerformance engineeringCode generationRuntime systems

Required

Bachelor's degree or equivalent practical experience

2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree

Experience in low-level GPU programming (e.g., CUDA, Triton, CUTLASS, etc.) and performance engineering techniques

Experience in modern GPU architectures (NVIDIA, AMD, or other AI accelerators), memory hierarchies, and performance bottlenecks

Preferred

Master's degree or PhD degree in Computer Science or related technical fields

2 years of experience with data structures or algorithms in either an academic or industry setting

Experience with compiler improvement, code generation and runtime systems for GPU architectures (OpenXLA, MLIR, Triton, etc.)

Understanding of modern Large Language Models (LLMs) and their deployment on AI accelerators

Benefits

Bonus

Equity

Benefits

Company

Google

Glassdoor4.4

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

Founded in 1998

Mountain View, California, USA

10001+ employees

https://www.google.com

H1B Sponsorship

Google has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (8763)

2024 (8872)

2023 (9682)

2022 (11626)

2021 (9109)

2020 (9785)

Funding

Current Stage

Public Company

Total Funding

$26.1M

Key Investors

Andy Bechtolsheim

2004-08-19IPO

1999-06-07Series Unknown· $25M

1998-11-01Angel· $1M

Leadership Team

Sundar Pichai

CEO

Thomas Kurian

CEO - Google Cloud

Recent News

The Indian Express

Who is Ragini Das? Rejected by Google 12 years ago, she now leads its startup arm in India

2025-10-08

Tech.eu

Profits up at Google UK, but nearly 400 jobs cut

2025-10-04