45 mins + 15 mins QnA
Topics
Separately study the uplift on conversion rate and average order value.Understand what CUPED is and how it can help you save visitors.Learn how to create low-variance proxies for your metrics.Replace the outliers in your data and boost the power of your tests.Audience
This talk is for you if:
You are running tests with continuous metrics like revenue per visitor.You are struggling to get significance because of large outliers.Don't know what variance is and why you should care about it.Have heard a lot about CUPED but don't know what it is.After this talk, you will understand why some metrics have high variance and what to do about them.
Hi! I am a statistician, a teacher and the founder of Thinking Bell.
I am known for simplifying experimentation with analogies, doodles, and games that make decisions sharper and science practical.
I have led data science research at VWO and I have authored the VWO Stats Blog. In 2025, I taught a statistics bootcamp for a team of 60 marketers, product managers and data scientists.
Join me to master experimentation with clarity, depth, and fun.
Stat-Talk #8
Dealing with High Variance Metrics
Boosting the Power of Your Tests
Curious to Dive Deeper?
See Our Entire Course Curriculum
Join the 30-student cohort and master A/B testing stats through live classes, games, and community.