Per https://pytorch.org/docs/master/notes/multiprocessing.html 12 it seems that memory is shared already so it’s not clear to me what the main process is spending its time on. Is it just deserializing the tensor handles?