Hi, I face a strange issue. I am training a simple fully connected network on mnist dataset.
I have used ‘torch.manual_seed’ for code reproducabiliity.
In general, I got an accuracy like acc = [0.3722, 0.3514, 0.4277] in the first three epochs.
When I add a definition of an extra network (which I do not use in training and I do not feed it to optimizer), I get different results!!
I check my code multiple times, but just commenting the line of the definition of an extra network returns the results to the general case even if I have used random shuffle in dataloader.