This should not matter for the evaluation, right? Especially on cpu. As there is not randomness (dropout, cudnn )
Though I tried to fix numpy and torch random seeds and still there is a variation during GRU forward pass call.