@tom If we figure this out, it’s possible to do label smoothing / class weighting in CTC - rather cool  Gradient of NLL wrt softmax logits indeed seems to be like the paper claims, but for CTC grad wrt activations - needs checking. If you give it a look, let me know