Thank you very much for the explanation. I partly understand what you said now. So if I want to, say check some self defined status, like “foo” of the weights of layers in the model, using multiple GPUs (as I need to do experiments on very large dataset), is there any way to achieve what I want? Thank you again.