Hi !
I’m currently using multiprocessing in a project, and I was wondering if I had a way not to reinitialize CUDA on every process (which takes approximately ~300Mo of VRAM from what I saw).
I send models to the processes and dont expect to get anything back that is related to PyTorch.
I already tried using Queues, share_memory and sending the state_dict, but none of these worked.
From what I read so far, it seems that it is unavoidable, is this true ? And if not, what would be a workaround ?
Thanks, and sorry for the question.