Could you check the inputs for NaNs and Infs, please?
I assume the NaNs are returned during training?
Could you store the inputs with the model’s state_dict, so that we could reproduce it in a single iteration?