A/B testing statistical significance calculator

Calculate statistical significance for your A/B tests. Enter audience and conversion data to determine if your results are statistically significant with confidence levels and p-values.

Campaign type

Variant A

Recipients

Conversions

Variant B

Recipients

Conversions

Confidence

Hypothesis

Enter performance to check statistical significance

Variant A conversion rate

Variant B conversion rate

Power

p value

How to use this calculator

Select the campaign type that matches your data. Labels for each variant update (for example, impressions for ads, visitors for web).
Enter the exposure count and conversions for each variant of your A/B test.
Select your desired confidence level (95% is standard for most tests).
Choose one-sided if you only care whether B beats A, or two-sided if you want to detect any difference.
Review the results to see if your test has reached statistical significance.

Note: Statistical significance indicates that the observed difference is unlikely due to chance. However, also consider practical significance (is the lift meaningful for your business?) before making decisions.