I’m quite concerned about how to free GPU memory when OOM error occurs. It’s quite easy for Theano, but I don’t know how for Pytorch.
This is a quite serious problem because when OOM occurs in deployment environment, we can’t kill the process and start it again.