Hi,
I am looking for saving model predictions and later using them for calculating accuracy. The dataset has 20000 samples, I was trying to use
prediction_list.append(prediction)

And then using torch.save  to save them. But this gives this error:
RuntimeError: CUDA out of memory. Tried to allocate 16.00 MiB (GPU 0; 31.72 GiB total capacity; 30.73 GiB already allocated; 6.12 MiB free; 19.83 MiB cached)

Is there any methods to save them, not facing this error?