Hi,
I’m running tests without the learning rate scheduler now. The OOM error occurs on the inference step (i.e. output = model(image) ), so deteching it wouldn’t make a difference at this point as that occurs after the inference is complete. Also this error occurs even when it is just evaluation being computed.
Yeah sorry that was because I am currently using running tests where evaluation takes place on the CPU only and hadn’t changed the code back properly. FYI the training loop does work without OOM errors when the model is moved to the CPU and then evaluated there (ofc, as that has nothing to do with CUDA).
Thanks.