GJ, overall pretty nice, occasionally infinite repetition, my goto model now after some sampler adjustment
#2
by
imoc
- opened
And I stumbled upon this:
https://www.reddit.com/r/LocalLLaMA/comments/1ap8mxh/what_causes_llms_to_fall_into_repetitions_while/
https://github.com/valine/NeuralFlow
Looks interesting, what do you think think think?
imoc
changed discussion title from
GJ, overall pretty nice, occasionally infinite repetition
to GJ, overall pretty nice, occasionally infinite repetition, my goto model now after some sampler adjustment
Hi, would you mind sharing your prompt, sampling params and the quant version you are using?