Thanks for your reply. Sorry for not being concrete - what I mean is, that I expect to always attain the same outputs/loss after each epoch, when restarting the training with the same hyperparameters. I.e. I expect the network to reproduce previous results.