It’s more of an empirical knowledge of practitioners than an academic result (note that it’s the same for freezing the body of the network when fine-tuning in computer vision, it’s taught in courses, but there are not many academic papers discussing it, may are not even doing it). I saw a paper confirming this once, but forgot the reference :-/