- / A/B testing statistical significance calculator
A/B testing statistical significance calculator
Calculate statistical significance for your A/B tests. Enter visitor and conversion data to determine if your results are statistically significant with confidence levels and p-values.
Variant A*
Variant B*
Confidence
The probability that the observed difference is not due to random chance. Higher confidence means more certainty but requires more data.
Hypothesis
One-sided tests if B is better than A. Two-sided tests if there's any difference between A and B.
Enter visitor and conversion data for both variants to see results.
How to use this calculator
- Enter the total number of visitors and conversions for each variant of your A/B test.
- Select your desired confidence level (95% is standard for most tests).
- Choose one-sided if you only care whether B beats A, or two-sided if you want to detect any difference.
- Review the results to see if your test has reached statistical significance.
Note: Statistical significance indicates that the observed difference is unlikely due to chance. However, also consider practical significance (is the lift meaningful for your business?) before making decisions.
Browse more tools
Calendar link generator
Generate calendar event links for Google Calendar, Apple Calendar, Outlook, and more.
Code snippet generator
Transform your code into beautifully styled, email-compatible HTML snippets with syntax highlighting.
Mailto link generator
Create mailto links with pre-filled recipients, subject lines, body text, CC, and BCC fields.
