OS: ubuntu 16.04
Cuda: 10.2
pytorch: 1.8.0
I ran the demo https://pytorch.org/tutorials/recipes/recipes/amp_recipe.html#a-simple-network 1.
default precision training time is 1.760 sec and mixed precision training time is 0.833. 2x speed up. But when I use torch.nn.Conv2d, amp training is slower than default model. please tell me why?