Staff Software Engineer, ML Performance jobs in United States
cer-icon
Apply on Employer Site
company-logo

Google · 1 day ago

Staff Software Engineer, ML Performance

Google is a leading technology company that develops next-generation technologies impacting billions of users. They are seeking a Staff Software Engineer to develop Machine Learning performance analysis and optimization technology, focusing on enhancing TPU platform performance and collaborating with product teams to address AI challenges.

AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Engage with Google product teams, Cloud and researchers to solve their performance problems, such as onboarding ML models and products, and enabling giant models to train and serve efficiently
Apply optimization techniques, such as quantization and sparsity, to improve model performance while meeting pre-defined quality characteristics
Collaborate with partner teams on complementary performance optimizations: compiler, custom kernels, sharding
Design, write, and test product or system development code
Triage product or system issues, including end-to-end performance

Qualification

Machine Learning infrastructureML designJAX/PyTorch/TensorFlowData structuresAlgorithmsCustom TPU/GPU kernelsTechnical leadershipSoftware developmentSoftware designArchitectureSpeech/audio technologyReinforcement learning

Required

Bachelor's degree or equivalent practical experience
8 years of experience in software development
5 years of experience testing, and launching software products, and 3 years of experience with software design and architecture
5 years of experience with one or more of the following: Speech/audio (e.g., technology duplicating and responding to the human voice), reinforcement learning (e.g., sequential decision making), ML infrastructure, or specialization in another ML field
5 years of experience with ML design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning)

Preferred

Master's degree or PhD in Engineering, Computer Science, or a related technical field
8 years of experience with data structures and algorithms
3 years of experience in a technical leadership role leading project teams and setting technical direction
3 years of experience working in an organization involving cross-functional, or cross-business projects
Experience in Machine Learning models (ML theory) and systems (JAX/PyTorch/TensorFlow/similar)
Experience with custom TPU/GPU kernels

Benefits

Bonus
Equity
Benefits

Company

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

H1B Sponsorship

Google has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (8763)
2024 (8872)
2023 (9682)
2022 (11626)
2021 (9109)
2020 (9785)

Funding

Current Stage
Public Company
Total Funding
$26.1M
Key Investors
Andy Bechtolsheim
2004-08-19IPO
1999-06-07Series Unknown· $25M
1998-11-01Angel· $1M

Leadership Team

leader-logo
Sundar Pichai
CEO
linkedin
leader-logo
Thomas Kurian
CEO - Google Cloud
linkedin
Company data provided by crunchbase