Solved by ptrblck in post #2 
              
              
                Most likely you are reshaping/permuting in a wrong way. 
Usually these kind of interleaved outputs are created, if you wanted to swap some dimensions and have used view/reshape instead of permute. 
Could this be the case?