word timestamp

by leoh - opened 13 days ago

leoh

13 days ago

Hi team !

Super happy for this new version of distil-large. I am wondering if you did also the distillation for the specific heads of word timestamps ?

Thanks,

bofenghuang

11 days ago

We've only included the segment-level timestamps in distillation. For the word-level timestamps, we use attention heads from the last half of the decoder layers, but no additional training has been done.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment