Most likely you are reshaping/permuting in a wrong way.
Usually these kind of interleaved outputs are created, if you wanted to swap some dimensions and have used view/reshape instead of permute.
Could this be the case?