Hi,
If I understand correctly, you only turned shuffle off and experienced an increase in loss while training. Or you have trained a model already and when testing, turning shuffle off caused an increase in test loss?