Apply on Employer Site

Google DeepMind · 1 day ago

Group Product Manager, Gemini App, User Intent & Quality

Mountain View, CA

Full-time

Onsite

Director/Executive

$227K/yr - $320K/yr

6+ years exp

Google DeepMind is a team of scientists and engineers advancing the state of the art in artificial intelligence. In this role, you will architect the standards for Response Quality in the Gemini App, ensuring a high-quality user experience by defining evaluation frameworks and leading cross-functional efforts to optimize model outputs for critical user journeys.

Artificial Intelligence (AI)Business DevelopmentMachine Learning

Growth Opportunities

Responsibilities

Define the Quality Bar: Develop and maintain North Star metrics for Response Quality, defining "helpfulness" across text, code, and multimodal modalities

Cohort-Specific Optimization: Identify the needs of Critical User Cohorts (e.g., power users vs. casual seekers), analyze performance gaps, and prioritize model tuning to address them

Own User Journey Excellence: Ensure the model provides a frictionless, accurate, and delightful experience for the most vital user journeys

Implicit Alignment & Tuning: Partner with Research and Data Operations to steer model outputs through SFT (Supervised Fine-Tuning) and RLHF, translating qualitative feedback into structured data strategies

Evaluation Strategy: Design and scale sophisticated human-in-the-loop and "LLM-as-a-judge" evaluation pipelines to understand model performance in Side-by-Side (SxS) testing

Qualification

Product ManagementAI/ML ExperienceUser Journey OptimizationUser Psychology ExpertiseData AnalysisStrategic InfluenceUser-Obsessed MindsetQuality-First MindsetComfort with Ambiguity

Required

6+ years of progressive experience in product management, including at least 5 years in senior roles leading consumer products

Track record of building consumer products with millions of users that people genuinely love

Experience with AI or ML-powered products and a perspective on how AI will change consumer software

Comfort with ambiguity and the ability to define product direction in a fast-moving, novel space

User-obsessed mindset with a habit of talking to users directly and frequently

Preferred

Expertise in User Psychology to articulate why a response feels 'right' or 'wrong' in context

Data-Obsessed mindset with the ability to find 'signal in the noise' within massive evaluation datasets

Quality-First mindset with a high bar for technical ship-readiness

Ability to exercise Strategic Influence across Research, Engineering, and Content teams

Benefits

Bonus

Equity

Benefits

Company

Google DeepMind

Glassdoor4.5

Google DeepMind aims to research and build safe artificial intelligence system to solve intelligence and advance science and humanity. It is a sub-organization of Google.

Founded in 2010

London, England, GBR

501-1000 employees