Yes,  I used the Pytorch version of 1.0, and I update to the version of 1.3, it worked.
And I have the other question:
Inception model
Test Accuracy of the model on the 10000 test images: 98.88 %
Inception Net without lr-decay, time cost： 165.26964279999999
VGG model:
Test Accuracy of the model on the 10000 test images: 99.5 %
VGG16_BN  with lr-decay, time cost： 125.38929489999964
Ensemble model:
Test Accuracy of  ensemble model on the 10000 test images: 99.55 %
time cost： 221.52177070000016
Is it reasonable?  I  have saved the pretrained model, and I trained the ensemble model, it cost more time?
Am I doing the right ensemble convs?
Waiting  for your reply~:smile: