Hi. I’m studying about torch’s autograd engine.
I found calling empty_cache while doing loss.backward.
This behavior only occurs on the first.
I know that Pytorch’s memory allocator uses cached pool.
So i think
There is no reason to call an empty cache().
But Pytorch calls that.
What’s the reason?