I think you’re right.
So in RNN optimization does clipping over loss + L2 penalty make a big difference to only clipping over loss?
If it does , how should implement the code which can clip over loss + L2 penalty?
Many thanks.