Data Science, Statistics, Permutation Test, Monte Carlo Method.
and B → results from AB test Combine data in two group and randomly sample w/o replacement new_A, new_B with same size as before Calculate mean CTR difference Repeat 2,3 R times. Check if true mean CTR difference lie within 95% confidence interval. Python example a_group, b_group represent actual