live cohort COURSE

Master the Stats of A/B Testing

Lead Experiments with Clarity

Master the Stats of A/B Testing

Lead Experiments with Clarity

See through the fog of fluctuating results, false winners and hard-to-prove insights.

See through the fog of fluctuating results, false winners and hard-to-prove insights.

Choose the right metrics. Set the right sample size. Know when to stop your test.

Choose the right metrics. Set the right sample size. Know when to stop your test.

May 11th - May 25th, 2026

9:30 AM - 12:00 PM EST

Enroll Now

Enroll Now

Know More

Know More

live cohort COURSE

Master the Stats of A/B Testing

Lead Experiments with Clarity

See through the fog of fluctuating results, false winners and hard-to-prove insights.

Choose the right metrics. Set the right sample size. Know when to stop your test.

May 11th - May 25th, 2026

9:30 AM - 12:00 PM EST

Enroll Now

Enroll Now

Know More

Know More

live cohort course

Master the Stats of A/B Testing
Lead Experiments With Clarity

Core Program

$960.00

$1199.00

First 5 Sessions + QnA

Complete Program

$1280.00

$1599.00

All 7 Sessions + QnA

Enroll Now

Enroll Now

100% Money-Back Guarantee

Course Highlights

Course Highlights

sessions

7 x 2.5-Hour Live Sessions

question and answer

1.5 Hour QnA Session

One-on-One Focus

30 Student Cohort

Peer Interaction

Breakout Room Puzzles

Post-class revision

Get Detailed PDF Notes

Dedicated guidance

30-Minute One On One

risk-free investment

100% Money-Back

lifetime access

Alumini Meets

sessions

7 x 2.5-Hour Live Sessions

question and answer

1.5 Hour QnA Session

One-on-One Focus

30 Student Cohort

Peer Interaction

Breakout Room Puzzles

Skills to Take Away

Skills to Take Away

Choose the right metrics to run faster, conclusive and insightful tests.

Configure statistics to get trustworthy and highly powered test results.

Identify unreliable results and discern the underlying biases and errors.

Extract meaningful insights by dissecting data into audience segments.

Guide the plan of action when test results are unexpected and inconclusive.

Mentor your team to think scientifically and innovate with trial and error.

Save visitors by using smart statistical strategies on low-traffic pages.

Sharpen your decision-making by incorporating Bayesian priors in testing.

Is This Course For You?

Is This Course For You?

Designed for marketers, product managers, data scientists and leaders who believe in making decisions with data.

This course is for you if you have ever experienced:

The frustration of looking at fluctuating statistics that do not seem to converge.

The distress of not getting statistical significance on a logically promising idea.

The struggle of running experiments when visitor traffic is low.

The anxiety of not knowing when an A/B test winner is genuine or not.

The fatigue of convincing people when you have a finding contrary to popular belief.

This course teaches how to tackle these challenges with an intuitive understanding of randomness.

Core or Complete Offering?

Core or Complete Program?

The Core Program has been designed for people who are constrained on time and would prefer skipping advanced statistics that are used less in practice.

The Complete Program has two more sessions for people who are keen to do custom statistical analysis on their tests for greater accuracy and saving visitors.

The Curriculum

The Curriculum

Session-1

Seeing Clearly: Why is A/B Testing Needed?

Mon, May 11th, 2026

9:30 AM - 12:00 PM EST

Start by understanding the problems with randomness and the various biases that cause data to show false patterns. Grasp why randomness cancels most of these biases and what makes A/B testing trustworthy.

Confounder BiasSelection BiasCollider BiasRandomised Controlled TrialsCausal InferenceStatistical SignificanceScientific Thinking

Session-1

Seeing Clearly: Why is A/B Testing Needed?

Mon, May 11th, 2026

9:30 AM - 12:00 PM EST

Start by understanding the problems with randomness and the various biases that cause data to show false patterns. Grasp why randomness cancels most of these biases and what makes A/B testing trustworthy.

Session-2

Truth, Noise and Sample Size: Decoding the Statistics of Significance

Wed, May 13th, 2026

9:30 AM - 12:00 PM EST

Decipher the intuition behind calculating statistical significance and the two kinds of errors in decisions. Understand the fundamental tradeoffs in calculating a sample size and how to set one based on context.

T-StatisticP-ValuesSample SizeMinimum Detectable EffectFalse PositivesStatistical Power

Session-2

Truth, Noise and Sample Size: Decoding the Statistics of Significance

Wed, May 13th, 2026

9:30 AM - 12:00 PM EST

Decipher the intuition behind calculating statistical significance and the two kinds of errors in decisions. Understand the fundamental tradeoffs in calculating a sample size and how to set one based on context.

Session-3

Creatively Designing your Experiments for Maximum Insights

Fri, May 15th, 2026

9:30 AM - 12:00 PM EST

Learn to design tests with the right metrics, a suitable audience and the correct statistical configuration. Know the right approach to balance between the accuracy of insights and investment of visitors.

Causal DiagramsFalse Positive vs False Negative TradeoffOne-Sided vs Two-Sided Tests3 Types of MetricsTriggering

Session-3

Creatively Designing your Experiments for Maximum Insights

Fri, May 15th, 2026

9:30 AM - 12:00 PM EST

Learn to design tests with the right metrics, a suitable audience and the correct statistical configuration. Know the right approach to balance between the accuracy of insights and investment of visitors.

Session-4

Handling Data, Analysing Results and Making Decisions

Mon, May 18th, 2026

9:30 AM - 12:00 PM EST

Discover the different checks to run on results and find insights by segmenting the data into groups. Identify unreliable results, make robust decisions and decide the next steps on a test.

Outlier DetectionSample Ratio MismatchPostsegmentationTime LatenciesTwyman’s LawStatistical Decision Making

Session-4

Handling Data, Analysing Results and Making Decisions

Mon, May 18th, 2026

9:30 AM - 12:00 PM EST

Discover the different checks to run on results and find insights by segmenting the data into groups. Identify unreliable results, make robust decisions and decide the next steps on a test.

Session-5

Understanding and Selecting the Right Metrics

Wed, May 20th, 2026

9:30 AM - 12:00 PM EST

Make sense of the different properties of metrics and learn how they impact your test. Discuss and debate through various real-world examples to build an intuition on the pitfalls of metric selection.

11 Characteristics of MetricsGameability of MetricsPitfalls in Metric SelectionDealing with High-VarianceCase Studies from the Big-Tech

Session-5

Understanding and Selecting the Right Metrics

Wed, May 20th, 2026

9:30 AM - 12:00 PM EST

Make sense of the different properties of metrics and learn how they impact your test. Discuss and debate through various real-world examples to build an intuition on the pitfalls of metric selection.

Session-6

Advanced Statistical Tricks for Higher Accuracy and Power

Fri, May 22nd, 2026

9:30 AM - 12:00 PM EST

Decode the fundamental intuition behind Bonferroni Correction, Sequential Testing and tests of Asymmetric Power. Understand why they matter, when they matter and how to use them.

Bonferroni CorrectionSequential TestingAsymmetric PowerNon-Inferiority TestingSuperiority-Testing

Session-6

Advanced Statistical Tricks for Higher Accuracy and Power

Fri, May 22nd, 2026

9:30 AM - 12:00 PM EST

Decode the fundamental intuition behind Bonferroni Correction, Sequential Testing and tests of Asymmetric Power. Understand why they matter, when they matter and how to use them.

Session-7

Untangling the Bayesian vs Frequentist Debate for Sharper Decisions

Mon, May 25th, 2026

9:30 AM - 12:00 PM EST

Understand the nuances of the age-old statistical debate and realize why it matters in A/B testing. Decipher why many of your winners are false and learn to incorporate your prior knowledge in decisions.

Backward ProbabilityBayesian StatisticsFrequentist StatisticsFalse Discovery RatesPriorsThinking Bayesian

Session-7

Untangling the Bayesian vs Frequentist Debate for Sharper Decisions

Mon, May 25th, 2026

9:30 AM - 12:00 PM EST

Understand the nuances of the age-old statistical debate and realize why it matters in A/B testing. Decipher why many of your winners are false and learn to incorporate your prior knowledge in decisions.

Session-8 (Optional)

Question & Answer

Tue, May 26th, 2026

9:30 AM - 11:00 PM EST

Selected questions from the course will be discussed in detail.

Session-8 (Optional)

Question & Answer

Tue, May 26th, 2026

9:30 AM - 11:00 PM EST

Selected questions from the course will be discussed in detail.

Enroll Now

Enroll Now

Meet Your Mentor

Meet Your Mentor

Ishan Goel

Ishan Goel

Built the Stats Engine at VWO

Built the Stats Engine at VWO

Founder & Educator

Former Head of Data Science

Author

Trained 60 Leaders

Founder & Educator

Former Head of Data Science

Author

Trained 60 Leaders

Hi! I am a statistician, an A/B testing expert and the founder of Thinking Bell.

I am known for simplifying experimentation with analogies, doodles, and games that make decisions sharper and science practical.

I have led data science research at VWO and I have authored the VWO Stats Blog. In 2025, I taught a statistics bootcamp for a team of 60 marketers, product managers and data scientists.

Join me to master experimentation with clarity, depth, and fun.

Know More

Know More

Frequently Asked Questions

Frequently Asked Questions

How can I remember all that has been taught in the course?

Will I get to interact with other students in the course?

Are there any assignments or tests that I need do outside class time?

Will there be breaks in the class?

What time are the classes for my time zone?

How can I remember all that has been taught in the course?

Will I get to interact with other students in the course?

Are there any assignments or tests that I need do outside class time?

Will there be breaks in the class?

What time are the classes for my time zone?

Still have questions?

Still have questions?

Contact Us

Contact Us

Stop Guessing With Data

Make Statistically Sound Decisions

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.

Enroll Now

Enroll Now

Stop Guessing With Data

Make Statistically Sound Decisions

Join the 30-student cohort and master A/B testing stats through live classes, games, and community.

Enroll Now

Enroll Now