To clarify, you’re asking that if we get a pretrained network (without freezing any layers) and train it on a transfer task, will the network get worse (or at least, is it possible)?

Yes this is what I mean.
Ok, thanks again I understand.