Data Science, Statistics, Permutation Test, Monte Carlo Method.
results from AB test. Then we calculate true mean ctr difference between two groups. 2,3,4. we’ve ran simulation 10000times. Note that due to Central Limit Theorem each group’s sample mean distribution will be normally distributed and therefore value distribution after any arithmetic operation will