markdaoust:

But maybe I can understand it with the “the layers of a resnet are a like gradient vector field pushing the embedding towards the answer” interpretation. I guess If I’m taking fewer steps each could be larger.


Right on.
Thanks so much, @markdaoust for the conversation and for looking into this.