Glean · 4 months ago
Senior/Staff Applied Scientist
San Francisco Bay Area
Full-time
Onsite
Senior Level
$175K/yr - $230K/yr
5+ years expGlean is an innovative AI-powered knowledge management platform that helps organizations find, organize, and share information efficiently. The role of Senior/Staff Applied Scientist involves defining KPIs, conducting empirical analyses, and collaborating on A/B experimentation to enhance Glean's document indexing and retrieval systems. The position also includes evaluating generative AI use cases and developing best practices across various evaluation tasks.
Agentic AIArtificial Intelligence (AI)Enterprise SoftwareGenerative AIMachine LearningSearch Engine
Responsibilities
Define KPIs, create data foundations and build visualizations to measure the efficacy of Glean’s world-leading document indexing, retrieval, ranking infrastructure, which powers its search and LLM-powered products, as well as other ways of content personalization such as ranking agents in an agent library
Conduct rigorous empirical analyses rooted in sophisticated techniques and a deep understanding of our ranking stack to identify & prototype ways to improve ranking at Glean. ML ENG teams would iterate & deploy these techniques into production
Collaborate with product data science and engineering teams to identify techniques, tooling and process improvements in online A/B experimentation to assist rigorous decision making across all relevant product domains
Develop and maintain our A/B experimentation platform based on stakeholder feedback
Write code or identify vendors to deploy these techniques to production in a scalable manner that’s easy to use by engineering, product data science, product management and design teams
End to end evaluation of various hero use cases like document/URL uploads, including evaluation set generation, coming up with evaluation criteria and methods to interpret the results
Breaking down end to end evaluations into more granular evaluation of various tasks & skills including but not limited to content summarization/analysis/generation, multi-step reasoning & strategizing, tool selection & use, coding & system design
Design, development and ownership of best practices, tools and processes across various evaluation problems, e.g. query intent classification, standardizing the use of best statistical principles to handle LLM stochasticity, industry benchmarking
Qualification
Required
5+ years of experience as a Masters degree holder, 3+ as a PhD degree holders (Masters/PhD degree in Statistics, Mathematics or Computer Science, or another quantitative field)
Strong in statistics and/or machine learning
Experience in applying these skills into tangible improvements in products, internal tools, and processes in a pragmatic way that puts business urgencies first
Very proficient in Python, e.g. proficient enough to maintain an internal source-controlled library used by dozens of others
Concise and precise in written and verbal communication. Technical documentation is your strong suit
Proficient in SQL and the modern data stack (e.g. source-controlled dbt pipelines for ETL/ELT)
Strong at defining good product KPIs/guardrail metrics, dashboarding and analysis of raw data to derive strategic insights
Experience in B2B SaaS
Experience working on ranking, developing, and maintaining A/B experimentation platforms and/or ML measurement problems
Passionate about using AI to improve the productivity of data teams as well as non-data professionals trying to derive more value of their company's data
Benefits
Medical, Vision, and Dental coverage
Generous time-off policy
The opportunity to contribute to your 401k plan
Home office improvement stipend
Annual education and wellness stipends
Healthy lunches daily
Company
Glean
Glean develops an AI-based search engine software that connects enterprise data and generates answers to improve workplace efficiency.
501-1000 employees
H1B Sponsorship
Glean has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22)
2024 (17)
2023 (7)
2022 (26)
Funding
Current Stage
Late StageTotal Funding
$768.2MKey Investors
Wellington ManagementSequoia CapitalGeneral Catalyst
2025-06-10Series F· $150M
2024-09-10Series E· $260M
2024-02-27Series D· $203.2M
Leadership Team
Arvind Jain
Founder and CEO
Michael Miao
VP of Finance & BizOps
Recent News
Business Insider
2025-12-24
2025-12-11
Company data provided by crunchbase