Hi,
What kind of objects will you save there? You can save cuda tensors in a python dictionary and there won’t be any copy when you access them.
Keep in mind that unless you call .cuda() or .t("cuda") on a Tensor, pytorch will never move stuff to and from the gpu. So it is easy for you to control when things are exchanged between the two.