It’s basically the “weird trick” from Alex Krizhevsky 9.
Since the number of computations and number of parameters differ a lot in these models between the feature and classifier part, this tries to get the best performance out of your model.