Could you check the logits range and compare it to the outputs? Since the loss is extremely large I would guess that outputs (i.e. your targets) might also contain large values? If so, try to normalize them during training and un-normalize the model output during validation to get the expected value ranges again.