That would be similar to my suggestion and would be possible:



 ptrblck:

You could train the CNN in Pytorch first, store all outputs of it after training, and train your SVM on these outputs (completely detached from PyTorch).


Just skip the training part