Apply on Employer Site

Google · 5 hours ago

Software Engineer, On-Device Machine Learning

Sunnyvale, CA

Full-time

Onsite

Entry, Mid Level

$141K/yr - $202K/yr

2+ years exp

Google is a leading technology company developing next-generation technologies that change how billions of users connect and interact with information. The Software Engineer role focuses on building and optimizing on-device machine learning solutions, driving innovation and performance improvements across various platforms.

AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO

Growth Opportunities

H1B Sponsor Likely

Responsibilities

Drive the development of next-generation on-device agents and multi-modal capabilities. Design and implement complex system features to enable robust product use cases in Chrome, Pixel Watch and across the ecosystem

Architect and optimize the LiteRT-LM engine to ensure scalable, production-ready inference on all backends. Own the end-to-end performance stack, leveraging techniques to maximize throughput and minimize latency

Partner with client engineers to ensure the seamless deployment of GenAI models on edge devices. Design frictionless developer APIs and ensure stable, high-quality production pathways for all users

Qualification

C++ML infrastructureMachine learning modelsData structuresAlgorithmsLLM inferenceGenAI optimizationProfiling toolsEdge device developmentSoft skills

Required

Bachelor's degree or equivalent practical experience

2 years of experience with software development in the C++ programming language

1 year of experience with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging)

1 year of experience working with machine learning models, or on-device systems

Preferred

Master's degree or PhD in Computer Science or related technical fields

2 years of experience with data structures and algorithms

Experience designing complex ML inference systems (i.e., LLMs or resource-constrained environments)

Experience with LLM inference, GenAI system optimization

Experience using profiling tools to optimize code for CPU, GPU, or NPUs

Familiarity with edge device development on Android, iOS, or Web (Wasm/WebGL)

Benefits

Bonus

Equity

Benefits

Company

Google

Glassdoor4.4

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

Founded in 1998

Mountain View, California, USA

10001+ employees

https://www.google.com

H1B Sponsorship

Google has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (8763)

2024 (8872)

2023 (9682)

2022 (11626)

2021 (9109)

2020 (9785)

Funding

Current Stage

Public Company

Total Funding

$26.1M

Key Investors

Kleiner Perkins,Sequoia CapitalAndy Bechtolsheim

2004-08-19IPO

1999-06-07Series Unknown· $25M

1998-11-01Angel· $1M

Leadership Team

Sundar Pichai

CEO

Thomas Kurian

CEO - Google Cloud

Recent News

Small Business Trends

Google Gemini Enhances API with Direct Data Inputs and Larger File Support

2026-01-24

Android Authority

A major Pixel-exclusive security feature could be the Galaxy S26’s secret weapon

2026-01-24

Search Engine Journal

User Data Is Important In Google Search, Per Liz Reid’s DOJ Filing via @sejournal, @marie_haynes

2026-01-24

Company data provided by crunchbase