Decent model
Noted from a Quant request located here: https://huggingface.co/mradermacher/model_requests/discussions/1289#68a3427143e57453205ad661
After searching and testing many 8B models I finally found what I was looking for. An absolute all-rounder
So far i'm playing around with it and... i think @hollywood2011 's right, it's overall a decent all-round 8B model that does good with RPing. I've had it explain and do code generation (which it loves python for some reason), RPing, song generation among some of the outputs.
Best of all because it's small it's incredibly fast and i can fit almost all of it (i1-Q6) in my 8Gb video card running it purely on GPU i get 10t/s.
I'll have to test the Q3 variant to see if it's reliable enough, if so I could put it on a DVD (with oobabooga's webui).