Interested to hear if you solved the problem. Tried setting all parameters as suggested here 49 (during training and during validation), but accuracies still differ substantially between training+saving and loading+validating the model.