Hi theoryofjake,

Can I put tensors in shared memory?

You can move tensors to shared memory torch.Tensor.share_memory_ — PyTorch 1.9.0 documentation 4.
A possible solution is to use a python dictionary and move the values to shared memory. Will this work for your case?