I found the general “temporal self-similarity matrix” (TSM) concept from RepNet 8 gave me lots of ideas about this kind of temporal problem. I’ve been using it, plus some alignment ideas from CTC 4, for some things.