Get artifacts, not usable text

#4
by MaratG2 - opened

Hi! I tried to use this model with Ollama, lots of different parameters: temperature (from 0.1 up to 1), top k and top p. Used Q3 quant. All the time I got artifacts: like one random sentence copied thousand times, or short sentence of completely unrelated text. From what I see it's completely unusable and will be worse than even random 1-2B model

it repeats the same paragraph over and over and over and over...

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment