How to free the memory used by processed layers in the testing/eval phase?
Hi. In the testing/eval phase, after one layer is processed is there anyway to free its memory? Or can the output tensors of all layers share the same memory, since the outputs are not needed for calculating the gradients. Thanks.
dhm
Training is already quite memory efficient. If it doesn’t need to hold onto some input/output because it can compute the gradient in another way, it won’t do it.
apaszke
Thanks. It is so convenient to use!
dhm