Hey,
I can’t think of a builtin way to do this. But you should be able to have a global variable shared by all the workers that contain this p that they will read and will be set by the main training process?
Maybe a 1 element Tensor will work as it will be shared across the processes.