Every time I manually interrupt training, some memory remains stuck. For example, interrupting this tutorial - http://pytorch.org/tutorials/beginner/transfer_learning_tutorial.html 6 during training phase consumes about 500mb. Memory is not connected to any objects, deleting everything in the notebook’s scope doesn’t release memory. Interrupting training second time adds the same amount of leaked memory to the “pool”. Restarting kernel helps:slight_smile:
Is there any way to release the memory or reset the graph similar to tf.reset_default_graph()?