Solved by eqy in post #2 
              
              
                I’m confused that you get the same results here. (e.g., in this code snippet the results are clearly not the same) 
$ cat temp.py
import torch

a = torch.randn(1, 8, 64, 1024)
b = a.reshape(1, 512, 1024)
c = a.permute(0, 2, 1, 3).reshape(1, 512, 1024)
a = a.view(1, 512, 1024)

print(torch.allclose(a…