Hello Thomas,
I’m using Awni Hannun codebase 2 to do phoneme recognition which uses his pytorch 0.4 warp-ctc bindings. I have recently started using pytorch’s native ctc loss function in pytorch 1.6, and I noticed that the convergence times for pytorch’s native loss function seem to be about 2-3 times slower than awni’s warp-ctc loss function.
I haven’t done thorough convergence comparisons of the two loss functions, but given your statement that “PyTorch 1.0 CTC loss is faster” I wanted to ask: is the native pytorch ctc loss function is faster than your warp-ctc bindings 2?
If the pytorch native loss function is faster than your bindings then perhaps there is something in my hyperparameter selection that is making the convergence of the pytorch native loss function slower.
Thanks for your time @tom!