That is an interesting idea for my image data.  I think pytorch has a pre-trained set with mnist right?  I will use this idea for my CNN model, however, what if the pre-train doesn’t already exist?  For example, my network is not CNN but a simple fully connected layered resnet? Then I assume I will have to do the pre-training myself.