Could you post the model definition as well as the training routine?
If you suspect that the data loading might be faulty, you could add torch.is_finite(data) inside the training loop to check that no input contains NaNs or Infs.