Infinite loop of processing

by Ejentos - opened Jan 10

Jan 10

Hi there,
I am trying to correct human speech and faced with the issue when XL and XL-composite models go to infinite processing. Here is the text example:
"fix grammar: hello! It's me. da da da da da da da da da da."
For sure 'da da da da' doesn't make any sense, but should it be an infinite loop? Any solutions?

jbochi

Jan 11

Hello. Can you please try setting a repetition_penalty or doing beam search when you call generate.

Ejentos

Jan 11

@jbochi thanks for the reply.
Indeed it solves the issue with the infinite loop of processing, but at the same time it might rephrase sentences dramatically (or skip some).

machineteacher changed discussion status to closed Apr 28

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment