Register_buffer will cause the tensor to be saved to disk, which he says he doesn’t want.  I don’t think there is a way to have a tensor or variable automatically moved to the gpu but not saved to disk.