Solved by TrentBrick in post #3 
              
              
                Thank you for your comment. However, when I did have a loss function and perform backprop the RAM also exploded. I was only trying to isolate the issue by removing the loss. 
You know, I went to get my code with the loss still in it and ended up finding the real bug! I was only calling zero_grad() o…