Data Science, Variance, A B Testing, LinkedIn.
for the t-statistic for the north star metric using a surrogate metric. Image by author. In figure 6, the numerator is the average lift of our surrogate metric i.e. the difference between the surrogate metric in our treatment and control. The denominator is the square root of the adjusted variance.