Hi Konpat,
thank you very much anyway! I follow ptblck’s advice to check nvidia’s usage and find during 20th epoch, in one of up-sampling layers, when i do skip-connection operation to concatenate 2 layers from encoder and decoder layer like in U-Net, the memory required for GPU just doubled and it therefore fails:

image.png771×33 1.96 KB

I may try to find a way to use another GPU card parallel during training or reduce my channels or CONV layers’ number in my model.
Thank you very much!
Best,
Peter