Solved by albanD in post #2 
              
              
                Hi 
Yes I don’t think the distribution objects are moved around by the nn.Modules. 
But If you want _zero_mean and _eye_covar to be moved around, you need to register them as buffers in the nn.Module.