You can have a look at various pre-trained models from torchvision.models 16.
I think these models are pre-trained on imagenet.
You are right, if you have a specific network architecture, you have to train the network yourself.
At least I don’t know any obvious technique for weight transferring between different architectures.