ptrblck:

You can script the model and store the scripted model


Do you mean saving and loading the entire model like here https://pytorch.org/tutorials/recipes/recipes/saving_and_loading_models_for_inference.html#save-and-load-entire-model 1?