Yes, you can use the .pth files to load model weights and from there you can use the intermediate activations of the model as features. The ImageNet example: examples/main.py at cbb760d5e50a03df667cdc32a61f75ac28e11cbf · pytorch/examples · GitHub 6
shows an example of loading from checkpoints.