Hi, all. I have tries both torch.save(network, filename) or torch.save(network.state_dict(), filename). Both of the two approach will have the same problem. when I saved the best accuracy checkpoint in training and recover it again, the recovered network always decrease by 3-5 percent, and It need some hours to retain the same accuracy again. On some condition, it will never reach the best performance again. I felt disappointed!
What’s wrong? Thanks.