Experimentation, Bayesian Statistics, Engineering, Data Science, Ab Testing.
to be ‘worse than control’ in any guardrail metric For a variant to be considered a winning variant, it must not only beat control in the primary metric, but also not be worse than control in any guardrail metric. This is crucial because Skyscanner is a complex two sided marketplace, with verticals