Solved by add023 in post #2 
              
              
                Ok. I found a way to do this. 

Get state dict of the original resnet18 that was used in training.
Get state dict of the collectively trained model.
Create a new state dict from collectively trained model where keys == keys in step 1.

from torchvision import models
from torch.hub import load_state_…