I have the exact same issue with torch.multiprocessing.spawn (mp.spawn) used for distributed parallel training.
Since I have a large dataset of csv files which i convert to a shared multiprocessing numpy array object to avoid memory leak outside of my main. but mp.spwan It makes multiple copies of it anyways.