To the best of my knowledge, the advice has always been to move your model first as the fact that the parameters don’t change in this has been more an implementation detail than part of the design.
It would seem that in most use cases, the traversing of the modules upon setup is rather small compared to running or training the models.
Best regards
Thomas