I am working on image classifying task. I am using torch.utils.data.DataLoader to load validation dataset.
When I change the parameter shuffle from True to False, I got different result, the sensitivity dropped. (Here, the result means sum of results from all validation data, so it should be the same as long as I am using same validation dataset). I found the validation result changes by the order of input data. Can this happen? What do you think is the cause of this instability?