I think this is super helpful! I hope pytorch provides full support of CTC in the nn module soon.
It’s great for personal practice but while developing tools for a general audience who are not very familiar with dependencies and requirement, it becomes a tough software engineering decision.