What You'll Learn
Understand what to do when an A/A test runs into winners.Learn to post-segment your test data to narrow down the issue.Debug the reason why you might be getting a false positive.Sanity-check your experimentation platform and identify the issue.This Webinar Is For You If
This talk is for you if:
You are confused whether you should run an A/A test or not.You suspect that there is a data bias in your experimentation platform.You ran an A/A test and you got an unexpected winner.False Positives are eroding your trust in the tool.I have helped dozens of experimenters with A/A test issues. After this talk, you will get my method that I developed after a lot of practice.
Hi, I am Ishan Goel, a statistician, educator and founder of Thinking Bell.
I previously led data science research at VWO, where I built VWO's Stats Engine.
Today, I teach experimentation statistics through analogies, simulations, games, doodles and real-world problems, making difficult statistical ideas intuitive and useful.
I have also taught experimentation and statistics to cross-functional teams across product, marketing and data, including a 60-person training programme at The Economist.
My goal is simple: help people reason confidently about experiments without turning them into statisticians.
Stat-Talk #12