Are you using pickle manually or are you trying to load the tensor via torch.load?
Also, in the latter case, would map_location='cpu' help?
Based on the error message it seems you are working with multiprocessing and the tensor loading is trying to re-initialize CUDA. Have you tried to use the suggested spawn method?