GPU or CPU memory? In my first PyTorch training loop I made the mistake of collecting model outputs in a container before I copied from GPU tensors back to CPU and then numpy, that exhausted my GPU memory pretty quickly…