Are you seeing an increasing loss during your training?
If so, your training is diverging and the model parameters might overflow after a certain number of iterations.
To avoid it you could try to e.g. lower the learning rate.