Thank you very much for your answer. I got it running in Colab, they use a GPU with 8GB Memory, the Network is using nearly all of it.
The batch size was already 1. torch.utils.checkpoints are used when training the network, if I understood correctly. I’m using a pretrained network and I’m doing only the forward pass in torch.no_grad()-mode, so it should have no effect, right?