Thanks for the info!
Are the other values (LAE and ELoss) for both runs comparable before they get nan using your RTX2080Ti?
Since DLoss is immediatelly nan for the first batch, could you check for invalid input values using torch.isnan and torch.isinf?
If you can’t spot anything, would it be possible to post a (small) executable code snippet?