Experimentation, Bayesian Statistics, Engineering, Data Science, Ab Testing.
recommends shipping variant B. This is because, as you can see in the scorecard in figure 2, while both B and C beat control in the primary metric, C was found to be worse than control in the guardrail metric, while on the other hand, B did not hurt the guardrail metric. Monitoring metrics are not