Apply on Employer Site

GrowthBook · 1 month ago

Experimentation Advocate

United States

Full-time

Remote

Mid Level

$150K/yr - $230K/yr

3+ years exp

GrowthBook is a company focused on digital experimentation, and they are seeking a data scientist to join their team as an Experimentation Advocate. The role involves driving conversations around experimentation, improving discourse on best practices, and addressing customer needs while shaping the product roadmap.

A/B TestingB2BDeveloper ToolsSoftwareTest and Measurement

No H1B

Responsibilities

Solving Challenging Customer Needs. GrowthBook’s customers often have multiple teams with different experimentation needs. Some teams will be experimenting across logged-in and logged-out tracking events; some teams will need to use pre-aggregated metrics and others will be working with raw event data; some teams will want to ship as early as they can rule out harm, and others will only want to ship clear winners. Answering these and other technical questions with both prospective and onboarding customers, as well as fielding experimentation-focused feature requests, will be an important part of the experimentation advocate’s roles

Improving the Quality of Experimentation Discourse. Advice online about best practices in experimentation can be fragmented or come from a particular perspective. As an open-core experimentation platform, GrowthBook serves a wide variety of experimenters with a wide variety of needs. To serve this community, the person in this role will be writing articles and engaging with online conversations about experimentation best practices and how to implement them with GrowthBook. Example questions: How can I think about the trade-offs between sequential testing and classical frequentist testing? What is the best way to measure long-term user behavior in a short-term test? How should I organize my data warehouse for efficient experiment and product analytics? Why is post-stratification on top of CUPED powerful for my use case? Other possible projects: A summary of the state of experimentation on GrowthBook; building a library of successful experiments

Leading the Internal Conversation about Experimentation Best Practices. In addition to serving as the external voice of GrowthBook, the experimentation advocate will attend conferences to speak, stay abreast of new developments, and share their knowledge and learnings with the team. This also means using your experience and knowledge to help shape the future of GrowthBook so it can stay at the cutting edge of experimentation practice

Qualification

Digital experimentationSQLStatisticsData warehousesCommunication skillsStartup experienceOpen-source contributionFeature flagsA/B testingProduct analytics tooling

Required

Expert in digital experimentation, with 2+ years working on or with a large scale experimentation platform

PhD or Masters background in statistics, or equivalent experience

Solid understanding of SQL and data warehouses

Experience working with internal or external stakeholders with experimentation needs

Fluent English and good communication skills

Startup experience or interest working in a small company

Preferred

Contributed to an open-source project

Ability to contribute to

Used feature flags or A/B testing at a previous company

Experience with building experimentation or product analytics tooling

Benefits

100% remote work from anywhere (within US time zones)

Health, Vision, and Dental benefits (we cover 100% of the cost for employees and 95% for dependents - though if located outside the US, benefits may vary)

Generous tech stipend for your home office (or coworking space)

Regular off-sites in exciting places