What You'll Learn
Discover how guardrails can make experimentation faster and safer.Understand the 4 levels of safety you can configure with guardrail metrics.Master how to protect the gamification of metrics by pairing a primary metric with a guardrail.Learn from case studies at Airbnb and Google for using guardrails.This Webinar Is For You If
This talk is for you if:
You are worried about hurting crucial metrics while running tests.You know about guardrail metrics but feel you are not using them properly in testing.Leading metrics of your product show improvement, but still main business KPIs do notYou want to set up a system that allows your team to run more experiments.After this talk, you will be able to think creatively on how you can use guardrail metrics for different purposes in your experimentation program.
Hi, I am Ishan Goel, a statistician, educator and founder of Thinking Bell.
I previously led data science research at VWO, where I built VWO's Stats Engine.
Today, I teach experimentation statistics through analogies, simulations, games, doodles and real-world problems, making difficult statistical ideas intuitive and useful.
I have also taught experimentation and statistics to cross-functional teams across product, marketing and data, including a 60-person training programme at The Economist.
My goal is simple: help people reason confidently about experiments without turning them into statisticians.
Stat-Talk #10