Solved by ptrblck in post #2 
              
              
                I don’t know which higher-level API you are using, but if I understand your issue correctly you are concerned about the determinism between two different runs using is_forward_pass=True and =False. 
If so, I would guess that the pseudorandom number generator is called additionally in the if_forward_…