Hi JuanFMontesinos,
Thanks for making that clear.
But how does PyTorch implement transpose on GPU? 
I didn’t find the source code in
pytorch/aten/src/ATen/native/cuda/
pytorch/aten/src/ATen/native/cudnn/
It will be great if you can point me to the correct file.
Fei