My impression was that the implied CTC backward has numerical stability problems, but in the end I didn’t dig into it too much.
You can just implement the CTC function, call it with double and call gradcheck if you’re interested in exploring this.
Best regards
Thomas