Tools
MDE Calculator for A/B Tests
In Online Experimentation, you don't choose your traffic. You work with what you have. This calculator tells you the smallest effect your test can detect given your site's traffic, so you can set honest expectations before you run a single experiment.
Two-tailed hypothesis. Detects effects in both directions. Use this as the default unless you have a directional hypothesis.
Statistical & Business Parameters
Probability of a false positive. Typically 0.05.
0.20 = 80% power. Lower beta = more sensitive test.
The proportion of visitors who convert today, before any experiment.
Test Design
Total unique visitors entering the test in the first week.
0.5 = 50/50 split, 0.33 = A/B/n three-way
Between 1 and 52.
0 = flat · +1000 = growing · -500 = declining
Common scenarios
| Scenario | |
|---|---|
| Stable site | |
| Campaign incoming | |
| SaaS launch spike | |
| High-traffic e-commerce | |
| A/B/C three-way test |