Hi, I am frequently going out of memory since I am working on mages and computer vision tasks like segmentation. I tried apex before but sometimes it shows really vired behavior that I can’t understand the reason. I tried also DataPrallel that doesn’t help too much. The last solution was DistributedDataParallel. For this, the documents of PyTorch were very confusing and I used some other tutorials but I haven’t still succeded to use it. Is there anyone to have other solutions or tricks to get ride of OOM error.  I also deleted the tensors that I didn’t need anymore.
Thank you in advance for your help.