does deleting all Tensors that reference the graph enough to free it from my GPU too or does your suggestion only free the computers memory?
I am seeing different errors. The most common with a batch size that is “normal” e.g. 16 or more I get this error:
RuntimeError: CUDA out of memory. Tried to allocate 2.00 MiB (GPU 3; 11.93 GiB total capacity; 11.34 GiB already allocated; 64.00 KiB free; 11.36 GiB reserved in total by PyTorch)

I believe this is caused by my giant trees.
At other times my error is simply freezing when my model is computing the forward pass.