I agree. The randomness is intrinsic and one might prefer deterministic when the target is production. But when doing research most people average their results between runs and check against any modification that they might have done. How about that situation. Can it be for example due to the learning rate being on the borderline? and by this I mean learning rate sometimes causes the model to converge and sometimes it doesn’t.