I see. But my question is, does the mseloss calculation depend only on the output and the targets or on the steps how it got to the output? Because, even if I explicitly make the ouput to be contiguous before calling mseloss, i dont see much of a difference, 140ms is still much much more than 2ms for the blstm case.