Solved by ptrblck in post #8 
              
              
                Thanks for the code. 
It seems that the additional call of the test method inside the training loop calls into the pseudo-random number generator and thus changes the order of the training data in the next step. 
This will result in a bit noise during the training, which thus yields a different end …