Solved by ptrblck in post #2 
              
              
                I guess you might be shuffling the data in your training DataLoader, which would thus yield random samples in all batches. 
If you want to use the same image, you could directly get it by indexing the dataset via: data, target = train_loader.dataset[index].