I tried with scale and it shows gradient mean something else than zero. So I think it start to work but it only can perform one iteration then throws memory error. I deleted all the variables and call
torch.cuda.empty_cache() but still same. How can I check which variable takes how much memory on GPU.
Also another question about patchwise UNET. As I said my input is [1,4,240,240,155] if I use patches ,for example [1,4,64,64,64] how can I arrange it for some custom different input? Manually padding zeros ? Or is there anything for that ?  Lİke object detectors does ?
Thanks
Abdullah