Stat-Talk #7

Stat-Talk #7

Save Visitors with Asymmetric Power

Save Visitors with Asymmetric Power

Save Visitors with Asymmetric Power

Understand Non-Inferiority and Superiority Testing

Understand Non-Inferiority and Superiority Testing

Understand Non-Inferiority and Superiority Testing

Shift the Null Hypothesis. Speed up Your Experiments.

Shift the Null Hypothesis. Speed up Your Experiments.

45 mins + 15 mins QnA

45 mins + 15 mins QnA

Topics

Asymmetric Power is a new technique to speed up testing that is gaining popularity. In this talk you will:

checkUnderstand why asymmetric power intuitively makes sense for faster testing.
checkLearn to shift the null hypothesis with ease and calculate the p-value.
checkDecipher the two modes of faster testing: Non-Inferiority and Superiority testing.
checkGrasp when to use these modes based on the context of your experiment.

Audience

This talk is for you if:

checkYou are regularly short of visitors to sufficiently power your tests.
checkYou have heard of Non-Inferiority Testing, but don't know what it is.
checkYou are keen on using statistics to run smarter testing at your organization.
checkYou have a lot of ideas, but don't have enough visitors to test them all.

After this talk, you will have an extra edge to save visitors for testing in your organization.

Meet Your Mentor

Meet Your Mentor

Ishan Goel

Ishan Goel

Built the Stats Engine at VWO

Built the Stats Engine at VWO

Founder & Educator

Former Head of Data Science

Author

Trained 60 Leaders

Founder & Educator

Former Head of Data Science

Author

Trained 60 Leaders

Hi! I am a statistician, a teacher and the founder of Thinking Bell.

I am known for simplifying experimentation with analogies, doodles, and games that make decisions sharper and science practical.

I have led data science research at VWO and I have authored the VWO Stats Blog. In 2025, I taught a statistics bootcamp for a team of 60 marketers, product managers and data scientists.

Join me to master experimentation with clarity, depth, and fun.

Stat-Talk #7

Save Visitors with Asymmetric Power

Understand Non-Inferiority and Superiority Testing

Watch Previous Stat-Talks

Our most liked sessions available right away!

Dealing with High Variance Metrics
Dealing with High Variance Metrics
Boosting the Power of Your Tests
Simplifying Stats of A/B Testing
Featured
Simplifying Stats of A/B Testing
Making Sense of Data
3 Ways to Tune Your Sample Sizes
Featured
3 Ways to Tune Your Sample Sizes
Set Accuracy and Visitors
Dealing with High Variance Metrics
Dealing with High Variance Metrics
Boosting the Power of Your Tests
Simplifying Stats of A/B Testing
Featured
Simplifying Stats of A/B Testing
Making Sense of Data
3 Ways to Tune Your Sample Sizes
Featured
3 Ways to Tune Your Sample Sizes
Set Accuracy and Visitors

Explore recorded StatTalks on Thinking Bell's Youtube Channel

Curious to Dive Deeper?

See Our Entire Course Curriculum

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.