CRO

Statistical Significance

Definition

What is Statistical Significance?

Confidence that an observed difference between A/B test variants is not due to random chance. Standard threshold is 95% confidence. Stopping a test before significance is reached produces false positives.

Related terms

Cross-linked concepts

A/B Testing

Splitting traffic between two or more page variants to measure which converts better. Statistical significance requires sample size based on baseline conversion rate and minimum detectable lift, usually 1,000+ conversions per variant.

Same category