Changed to model.eval() before prediction.
And it is now producing the same results for both shuffle: ‘False’ and ‘True’.
(I have both Dropouts and batch norm layers in my model)
Thanks! And no bug in Pytorch!