Yeah, well, your targets include the CTC blank. That’s not allowed.
I can recommend the Distill article Sequence Modelling with CTC 62 for an accessible explanation to how CTC works.
Best regards
Thomas