I am training a net. When I train it on the gpu it runs fine other than being slow.
When I train on the GPU  which I have used extensively with pytorch otherwise) the training quits abruptly.
I get the cryptic message : “double free or corruption (!prev)”
I have mapped the issue with breakpoints to being during backward().
As I increase batch size it gets worse. At batch size of 1 it may run for almost 1K iterations before crushing.
At batch size= 4 It usually happens with in the first 5 batches. every so often it will make it through 30 iterations before failing.
Anyone deal with something like this before?