Yes, sure. These are the max/min values of the denominator before getting an error.
max 3466.501953125 min 3464.61669921875
max 3466.2783203125 min 3462.81103515625
max 3466.5009765625 min 3464.6171875
max 3466.274658203125 min 3462.81591796875
max 3464.37353515625 min 3463.282470703125
max 3466.50537109375 min 3464.61962890625
max 3464.37109375 min 3463.28759765625
max 3466.51123046875 min 3464.6162109375
max 3466.273193359375 min 3462.81494140625
max 3464.3701171875 min 3463.287109375
max 3466.9697265625 min 3462.463623046875
max 3466.506591796875 min 3464.61962890625
max 3464.37255859375 min 3463.28173828125
max 3466.96875 min 3462.469482421875
max 3466.50732421875 min 3464.61767578125
max 3466.97021484375 min 3462.467041015625
max 3466.507080078125 min 3464.619873046875
max 3466.27734375 min 3462.8134765625
max 3464.37109375 min 3463.281982421875
max 3466.966796875 min 3462.467529296875
max 3468.5478515625 min 3464.38232421875
max 3466.505859375 min 3464.6142578125
max 3464.3720703125 min 3463.286865234375
max 3466.9716796875 min 3462.46923828125
max 3468.5419921875 min 3464.3779296875
max 3466.51025390625 min 3464.61572265625
max 3466.9677734375 min 3462.47021484375
max 3468.54345703125 min 3464.37744140625
max 3466.50634765625 min 3464.61865234375
max 3468.544677734375 min 3464.38330078125
max 3466.50244140625 min 3464.6181640625
max 3466.27099609375 min 3462.8115234375
max 3464.37548828125 min 3463.283935546875
max 3466.9716796875 min 3462.466064453125
max 3468.54248046875 min 3464.383544921875
max 3464.380615234375 min 3463.459716796875
max 3466.50634765625 min 3464.6181640625
max 3464.3740234375 min 3463.28271484375
max 3466.970703125 min 3462.4658203125
max 3468.54541015625 min 3464.37841796875
max 3464.37890625 min 3463.457763671875
max 3466.5078125 min 3464.6123046875
max 3466.970703125 min 3462.46826171875
max 3468.541748046875 min 3464.382568359375
max 3464.381591796875 min 3463.4609375
max 3466.505859375 min 3464.61669921875
max 3468.5390625 min 3464.3798828125
max 3464.38330078125 min 3463.45654296875
max 3466.50537109375 min 3464.61669921875
max 3464.377197265625 min 3463.455078125
max 3466.50390625 min 3464.615234375
max 3466.273681640625 min 3462.81298828125
max 3464.375 min 3463.28759765625
max 3466.964599609375 min 3462.46630859375
max 3468.542724609375 min 3464.37841796875
max 3464.3818359375 min 3463.45703125
max 3466.3603515625 min 3464.38037109375
max 3466.50537109375 min 3464.6181640625
max 3464.376953125 min 3463.2841796875
max 3466.96728515625 min 3462.462890625
max 3468.547119140625 min 3464.383056640625
max 3464.37841796875 min 3463.4580078125
max 3466.356201171875 min 3464.379638671875
max 3466.503662109375 min 3464.61474609375
max 3466.97119140625 min 3462.468505859375
max 3468.54248046875 min 3464.38232421875
max 3464.38232421875 min 3463.4599609375
max 3466.36083984375 min 3464.37939453125
max 3466.501953125 min 3464.62109375
max 3468.546875 min 3464.38037109375
max 3464.380859375 min 3463.458984375
max 3466.359130859375 min 3464.38134765625
max 3466.505859375 min 3464.61767578125
max 3464.380859375 min 3463.4541015625
max 3466.3515625 min 3464.379150390625
max 3466.506103515625 min 3464.614990234375
max 3466.35595703125 min 3464.380859375
max 3466.503173828125 min 3464.6171875
max 3466.27001953125 min 3462.81787109375
max 3464.369873046875 min 3463.279052734375
max 3466.9697265625 min 3462.46630859375
max 3468.541259765625 min 3464.378662109375
max 3464.3818359375 min 3463.45703125
max 3466.35888671875 min 3464.3828125
max 3465.03955078125 min 3464.380615234375
max 3466.50341796875 min 3464.61572265625
max 3464.373046875 min 3463.2841796875
max 3466.967529296875 min 3462.471435546875
max 3468.5419921875 min 3464.383544921875
max 3464.383544921875 min 3463.459716796875
max 3466.35791015625 min 3464.38134765625
max 3465.0439453125 min 3464.376220703125
max 3466.50341796875 min 3464.61572265625
max 3466.969482421875 min 3462.46630859375
max 3468.545166015625 min 3464.3857421875
max 3464.37841796875 min 3463.458984375
max 3466.35595703125 min 3464.379150390625
max 3465.04296875 min 3464.3798828125
max 3466.5078125 min 3464.61572265625
max 3468.539794921875 min 3464.3779296875
max 3464.376708984375 min 3463.46044921875
max 3466.359375 min 3464.378662109375
max 3465.0478515625 min 3464.376708984375
max 3466.50830078125 min 3464.61669921875
max 3464.377685546875 min 3463.4560546875
max 3466.3583984375 min 3464.381591796875
max 3465.04541015625 min 3464.3818359375
max 3466.50537109375 min 3464.6162109375
max 3466.352783203125 min 3464.381591796875
max 3465.0400390625 min 3464.379638671875
max 3466.505615234375 min 3464.6142578125
max 3465.03955078125 min 3464.38330078125
max 3466.5087890625 min 3464.6181640625
max 3466.27587890625 min 3462.8134765625
max 3464.370361328125 min 3463.28271484375
max 3466.96826171875 min 3462.46728515625
max 3468.545654296875 min 3464.382568359375
max 3464.380859375 min 3463.45654296875
max 3466.36083984375 min 3464.37939453125
max 3465.04931640625 min 3464.383056640625
max 3464.953125 min 3464.38037109375
max 3466.5029296875 min 3464.61767578125
max 3464.37109375 min 3463.28271484375
max 3466.9697265625 min 3462.4658203125
max 3468.545654296875 min 3464.38037109375
max 3464.383056640625 min 3463.455810546875
max 3466.3564453125 min 3464.37841796875
max 3465.0380859375 min 3464.3818359375
max 3464.95654296875 min 3464.376708984375
max 3466.50634765625 min 3464.614501953125
max 3466.96728515625 min 3462.470947265625
max 3468.54150390625 min 3464.3779296875
max 3464.383056640625 min 3463.4609375
max 3466.358154296875 min 3464.37939453125
max 3465.039306640625 min 3464.376953125
max 3464.9580078125 min 3464.38427734375
max 3466.49951171875 min 3464.61376953125
max 3468.54345703125 min 3464.3837890625
max 3464.381591796875 min 3463.45751953125
max 3466.358154296875 min 3464.3828125
max 3465.03857421875 min 3464.3798828125
max 3464.95361328125 min 3464.381103515625
max 3466.5009765625 min 3464.61572265625
max 3464.382568359375 min 3463.45263671875
max 3466.357666015625 min 3464.383056640625
max 3465.04296875 min 3464.376953125
max 3464.9599609375 min 3464.379150390625
max 3466.50732421875 min 3464.61572265625
max 3466.360107421875 min 3464.382568359375
max 3465.04443359375 min 3464.378662109375
max 3464.95947265625 min 3464.380859375
max 3466.506103515625 min 3464.6171875
max 3465.043701171875 min 3464.38134765625
max 3464.95849609375 min 3464.380126953125
max 3466.50341796875 min 3464.6171875
max 3464.95849609375 min 3464.383544921875
max 3466.50439453125 min 3464.61181640625
max 3466.27490234375 min 3462.81494140625
max 3464.37158203125 min 3463.2861328125
max 3466.9716796875 min 3462.463623046875
max 3468.54638671875 min 3464.376708984375
max 3464.38232421875 min 3463.4560546875
max 3466.359375 min 3464.38330078125
max 3465.0458984375 min 3464.3837890625
max 3464.957763671875 min 3464.3779296875
max 3466.45751953125 min 3464.38427734375
max 3466.5 min 3464.6181640625
max 3464.3759765625 min 3463.285400390625
max 3466.97021484375 min 3462.466552734375
max 3468.541015625 min 3464.37548828125
max 3464.3828125 min 3463.4560546875
max 3466.357177734375 min 3464.378173828125
max 3465.0439453125 min 3464.3837890625
max 3464.955322265625 min 3464.385498046875
max 3466.4580078125 min 3464.3779296875
max 3466.5029296875 min 3464.6181640625
max 3466.9716796875 min 3462.46337890625
max 3468.54296875 min 3464.380859375
max 3464.380126953125 min 3463.455078125
max 3466.3623046875 min 3464.384033203125
max 3465.044921875 min 3464.37890625
max 3464.95947265625 min 3464.380859375
max 3466.45556640625 min 3464.385009765625
max 3466.5048828125 min 3464.61572265625
max 3468.544921875 min 3464.384765625
max 3464.380859375 min 3463.45849609375
max 3466.35986328125 min 3464.376708984375
max 3465.04443359375 min 3464.378662109375
max 3464.953125 min 3464.379150390625
max 3466.45849609375 min 3464.3828125
max 3466.5048828125 min 3464.61767578125
max 3464.379150390625 min 3463.45947265625
max 3466.357421875 min 3464.3828125
max 3465.045654296875 min 3464.378173828125
max 3464.9609375 min 3464.380126953125
max 3466.4560546875 min 3464.380859375
max 3466.5009765625 min 3464.615234375
max 3466.36279296875 min 3464.377685546875
max 3465.045654296875 min 3464.3818359375
max 3464.95654296875 min 3464.385986328125
max 3466.45947265625 min 3464.38232421875
max 3466.506591796875 min 3464.617431640625
max 3465.04248046875 min 3464.385498046875
max 3464.9619140625 min 3464.382080078125
max 3466.45703125 min 3464.381103515625
max 3466.50830078125 min 3464.613525390625
max 3464.959716796875 min 3464.379638671875
max 3466.456298828125 min 3464.37646484375
max 3466.504638671875 min 3464.61669921875
max 3466.45556640625 min 3464.383056640625
max 3466.50341796875 min 3464.618408203125
max 3466.274658203125 min 3462.815185546875
max 3464.371826171875 min 3463.285888671875
max 3466.9697265625 min 3462.462646484375
max 3468.54248046875 min 3464.377197265625
max 3464.37646484375 min 3463.456787109375
max 3466.3583984375 min 3464.37939453125
max 3465.04443359375 min 3464.37890625
max 3464.95556640625 min 3464.378173828125
max 3466.45849609375 min 3464.38330078125
max 3465.380126953125 min 3464.380859375
max 3466.500244140625 min 3464.61767578125
max 3464.3740234375 min 3463.285888671875
max 3466.97412109375 min 3462.466552734375
max 3468.547119140625 min 3464.37646484375
max 3464.3818359375 min 3463.45947265625
max 3466.361083984375 min 3464.380126953125
max 3465.04345703125 min 3464.3818359375
max 3464.96142578125 min 3464.377685546875
max 3466.458251953125 min 3464.377685546875
max 3465.383544921875 min 3464.376953125
max 3466.50634765625 min 3464.61376953125
max 3466.97119140625 min 3462.464111328125
max 3468.543212890625 min 3464.3837890625
max 3464.37939453125 min 3463.4580078125
max 3466.35791015625 min 3464.3818359375
max 3465.039794921875 min 3464.382568359375
max 3464.952880859375 min 3464.381591796875
max 3466.461181640625 min 3464.385498046875
max 3465.382080078125 min 3464.38330078125
max 3466.501220703125 min 3464.614501953125
max 3468.54296875 min 3464.381591796875
max 3464.3798828125 min 3463.45654296875
max 3466.35693359375 min 3464.380126953125
max 3465.04345703125 min 3464.382080078125
max 3464.955078125 min 3464.37890625
max 3466.459228515625 min 3464.380859375
max 3465.386474609375 min 3464.38134765625
max 3466.505859375 min 3464.6162109375
max 3464.38427734375 min 3463.45458984375
max 3466.35888671875 min 3464.38427734375
max 3465.0419921875 min 3464.376708984375
max 3464.955078125 min 3464.376220703125
max 3466.458251953125 min 3464.37890625
max 3465.384033203125 min 3464.380126953125
max 3466.50537109375 min 3464.61767578125
max 3466.358642578125 min 3464.378662109375
max 3465.04443359375 min 3464.380615234375
max 3464.9580078125 min 3464.38330078125
max 3466.45849609375 min 3464.37890625
max 3465.38427734375 min 3464.3759765625
max 3466.5009765625 min 3464.6162109375
max 3465.039306640625 min 3464.3828125
max 3464.95654296875 min 3464.379150390625
max 3466.45654296875 min 3464.378662109375
max 3465.383544921875 min 3464.383544921875
max 3466.503662109375 min 3464.619140625
max 3464.96044921875 min 3464.3837890625
max 3466.45849609375 min 3464.382080078125
max 3465.381103515625 min 3464.384765625
max 3466.501220703125 min 3464.6171875
max 3466.459716796875 min 3464.380126953125
max 3465.38232421875 min 3464.38232421875
max 3466.50244140625 min 3464.61767578125
max 3465.3828125 min 3464.377197265625
max 3466.5078125 min 3464.614013671875
max 3466.27490234375 min 3462.81884765625
max 3464.3720703125 min 3463.287353515625
max 3466.97265625 min 3462.46435546875
max 3468.542236328125 min 3464.3818359375
max 3464.3798828125 min 3463.45654296875
max 3466.35986328125 min 3464.38037109375
max 3465.044677734375 min 3464.377685546875
max 3464.956787109375 min 3464.376708984375
max 3466.454345703125 min 3464.3828125
max 3465.382568359375 min 3464.379638671875
max 3464.5341796875 min 3464.37744140625
max 3466.501953125 min 3464.61767578125
max 3464.373046875 min 3463.284423828125
max 3466.9697265625 min 3462.462646484375
max 3468.543701171875 min 3464.38525390625
max 3464.378173828125 min 3463.45654296875
max 3466.359130859375 min 3464.382080078125
max 3465.03955078125 min 3464.382568359375
max 3464.957275390625 min 3464.38134765625
max 3466.459716796875 min 3464.377197265625
max 3465.38623046875 min 3464.380615234375
max 3464.535400390625 min 3464.378173828125
max 3466.50341796875 min 3464.613525390625
max 3466.970703125 min 3462.4658203125
max 3468.54296875 min 3464.3837890625
max 3464.384033203125 min 3463.45654296875
max 3466.3583984375 min 3464.380859375
max 3465.0400390625 min 3464.379150390625
max 3464.9580078125 min 3464.383056640625
max 3466.458984375 min 3464.37841796875
max 3465.386474609375 min 3464.38037109375
max 3464.535888671875 min 3464.3798828125
max 3466.5009765625 min 3464.6162109375
max 3468.545654296875 min 3464.383056640625
max 3464.3818359375 min 3463.46142578125
max 3466.35693359375 min 3464.382568359375
max 3465.041015625 min 3464.38037109375
max 3464.95751953125 min 3464.3828125
max 3466.456298828125 min 3464.384521484375
max 3465.37841796875 min 3464.37890625
max 3464.534423828125 min 3464.38525390625
max 3466.5068359375 min 3464.6162109375
max 3464.379150390625 min 3463.455810546875
max 3466.3583984375 min 3464.38134765625
max 3465.0478515625 min 3464.379150390625
max 3464.962890625 min 3464.3818359375
max 3466.457275390625 min 3464.3818359375
max 3465.385009765625 min 3464.376953125
max 3464.5341796875 min 3464.3779296875
max 3466.50634765625 min 3464.6201171875
max 3466.35791015625 min 3464.38037109375
max 3465.0419921875 min 3464.385498046875
max 3464.95458984375 min 3464.380859375
max 3466.45849609375 min 3464.380126953125
max 3465.38525390625 min 3464.38525390625
max 3464.531982421875 min 3464.3759765625
max 3466.5087890625 min 3464.6171875
max 3465.045654296875 min 3464.3876953125
max 3464.95361328125 min 3464.384033203125
max 3466.4560546875 min 3464.38037109375
max 3465.3828125 min 3464.381591796875
max 3464.531005859375 min 3464.37890625
max 3466.50830078125 min 3464.61474609375
max 3464.9521484375 min 3464.37646484375
max 3466.45751953125 min 3464.38134765625
max 3465.383056640625 min 3464.382568359375
max 3464.534423828125 min 3464.38427734375
max 3466.507080078125 min 3464.61767578125
max 3466.45361328125 min 3464.383056640625
max 3465.387939453125 min 3464.38623046875
max 3464.534423828125 min 3464.380615234375
max 3466.502685546875 min 3464.6171875
max 3465.38623046875 min 3464.3818359375
max 3464.5322265625 min 3464.380859375
max 3466.506103515625 min 3464.61474609375
max 3464.533447265625 min 3464.3759765625
loss is tensor(97.8701, device='cuda:0', grad_fn=<NegBackward>)
Warning: Traceback of forward call that caused the error:
  File "main.py", line 465, in <module>
    train_loss = train(model, train_iterator, optimizer, criterion, CLIP)
  File "main.py", line 383, in train
    output = model(src, trg)
  File "/home/shreyansh/anaconda3/lib/python3.7/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
  File "main.py", line 348, in forward
    output = self.decoder(trg, hidden, encoder_outputs)
  File "/home/shreyansh/anaconda3/lib/python3.7/site-packages/torch/nn/modules/module.py", line 532, in __call__
    result = self.forward(*input, **kwargs)
  File "main.py", line 310, in forward
    probabilities = self.stable_softmax(prediction)
  File "main.py", line 251, in stable_softmax
    numerator = torch.exp(z)
 (print_stack at /pytorch/torch/csrc/autograd/python_anomaly_mode.cpp:57)
Traceback (most recent call last):
  File "main.py", line 465, in <module>
    train_loss = train(model, train_iterator, optimizer, criterion, CLIP)
  File "main.py", line 391, in train
    loss.backward()
  File "/home/shreyansh/anaconda3/lib/python3.7/site-packages/torch/tensor.py", line 195, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph)
  File "/home/shreyansh/anaconda3/lib/python3.7/site-packages/torch/autograd/__init__.py", line 99, in backward
    allow_unreachable=True)  # allow_unreachable flag
RuntimeError: Function 'ExpBackward' returned nan values in its 0th output.