torch.nn.utils.clip_grad_norm_(model.parameters(), args.clip)

You can clip grads like that. AFAIK exploding gradients do happen in LSTMs though Im not an expert on them. Id suggest you to try clipping anyway and see if it works.