vymao:

I’m working on a cluster and allocated 100 GB of memory. Is this not available for the GPU?


Your current GPU has a capacity of 11.17GiB as given in the error message.
Are you allocating 100GB on your system RAM or are you combining the memory of all GPUs?
As explained by others you would have to either reduce the batch size (or model) or trade compute for memory via torch.utils.checkpoint.