Issue was that the original image was being reshaped in numpy instead of using a tranpose for the dimensions. Then placing it and extracting from pytorch causing the weird re-org. Moral of the story: always transpose dimensions instead of reshape!