Repetition, typos...
Hey! My feedback right after using the model for a bit. Sadly it tends to repeat itself quite a lot and even in very low context, saying the same sentences over on the next message. It also tends to have lots of typos, I have no clue why. I'll do more tests and follow the updates of the model, it seems promising on paper, maybe I'm doing something wrong too...
I close, not the original model's place 😅
This is a random drunken joke I made for myself. I merged my new model with an old busted favorite of mine to see what happens. If you want a quality 22B model I recommend https://huggingface.co/ReadyArt/The-Omega-Directive-M-22B-v1.0 or https://huggingface.co/ReadyArt/Forgotten-Abomination-22B-v4.0
I finally got around to actually trying it and I have to say that I'm not experiencing the same issue. My previous recommendation stands, but this is solid. Are you using my recommended settings?