Solved by ptrblck in post #2 
              
              
                It looks like you tried to permute your label tensor and somehow the dimensions got mixed up. 
Could you search for code using view, permute or another transformation on your labels, and post these here?