Data Science
A/B Testing Basics
Senior Data Analyst
May 18, 2026
6 min read
The Process
1. **Hypothesis**: New button increases clicks.
2. **Split**: 50% Control, 50% Treatment.
3. **Measure**: Conversion rate.
4. **Analyze**: Is the difference statistically significant?
Python Implementation
from scipy import stats
control = [0.05, 0.04, 0.06, ...] # conversion rates
treatment = [0.07, 0.08, 0.065, ...]
t_stat, p_value = stats.ttest_ind(control, treatment)
print(f"P-Value: {p_value:.4f}")
*Day 139: Time Series Forecasting Intro.*