Stat-Talk #3

Stat-Talk #3

3 Ways to Tune Sample Sizes

3 Ways to Tune Sample Sizes

Set Accuracy and Visitors

Set Accuracy and Visitors

Select the MDE. Cap the False Positives. Pick Low-Variance Metrics.

Select the MDE. Cap the False Positives. Pick Low-Variance Metrics.

Tuesday, February 10, 2026

Tuesday, February 10, 2026

10:00 AM EST

10:00 AM EST

45 mins + 15 mins QnA

45 mins + 15 mins QnA

Topics

Topics

Topics

checkTips to set the right MDE for your test
checkPicking low-variance metrics that save visitors.
checkSetting the accuracy by selecting the right alpha (false positive rate).
checkUnderstand one sided and two-sided tests.

Audience

Audience

Audience

This talk is for you if:

checkYou do not have enough traffic to reach statistical significance.
checkMany of your winners revert back to mean after they have deployed.
checkYou have been hearing about MDE and are unsure how to set it.

After this talk, you will have a practical understanding of setting the sample size for your tests.

Hi! I am a statistician, a teacher and the founder of Thinking Bell.

I am known for simplifying experimentation with analogies, doodles, and games that make decisions sharper and science practical.

I have led data science research at VWO and recently taught 60 leaders at The Economist. I have authored the VWO Stats Blog and have delivered 15+ talks for experimenters.

Join me to master experimentation with clarity, depth, and fun.

Stat-Talk #3

3 Ways to Tune Sample Sizes

Set Accuracy and Visitors

Watch Previous Stat-Talks

Our most liked sessions available right away!

Dealing with High Variance Metrics
Dealing with High Variance Metrics
Boosting the Power of Your Tests
Simplifying Stats of A/B Testing
Featured
Simplifying Stats of A/B Testing
Making Sense of Data
3 Ways to Tune Your Sample Sizes
Featured
3 Ways to Tune Your Sample Sizes
Set Accuracy and Visitors
Dealing with High Variance Metrics
Dealing with High Variance Metrics
Boosting the Power of Your Tests
Simplifying Stats of A/B Testing
Featured
Simplifying Stats of A/B Testing
Making Sense of Data
3 Ways to Tune Your Sample Sizes
Featured
3 Ways to Tune Your Sample Sizes
Set Accuracy and Visitors

Curious to Dive Deeper?

See Our Entire Course Curriculum

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.

Curious to Dive Deeper?

See Our Entire Course Curriculum

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.

Curious to Dive Deeper?

See Our Entire Course Curriculum

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.