Topics
Understand what to do when an A/A test runs into winners.Learn to post-segment your test data to narrow down the issue.Debug the reason why you might be getting a false positive.Sanity-check your experimentation platform and identify the issue.Audience
This talk is for you if:
You are confused whether you should run an A/A test or not.You suspect that there is a data bias in your experimentation platform.You ran an A/A test and you got an unexpected winner.False Positives are eroding your trust in the tool.I have helped dozens of experimenters with A/A test issues. After this talk, you will get my method that I developed after a lot of practice.
Hi! I am a statistician, a teacher and the founder of Thinking Bell.
I am known for simplifying experimentation with analogies, doodles, and games that make decisions sharper and science practical.
I have led data science research at VWO and I have authored the VWO Stats Blog. In 2025, I taught a statistics bootcamp for a team of 60 marketers, product managers and data scientists.
Join me to master experimentation with clarity, depth, and fun.
Stat-Talk #12
Sanity Check Your Platform
Debug Data & Stats with A/A Tests
Curious to Dive Deeper?
See Our Entire Course Curriculum
Join the 30-student cohort and master A/B testing stats through live classes, games, and community.