That appears to be a bug, thank you for pointing it out. I’ve opened an issue here: https://github.com/pytorch/pytorch/issues/4938 276.
Relevant reading is broadcasting semantics 70; something seems off about mse_loss.