TC RP

#7
by ItzPingCat - opened

Sica, was wondering what you would suggest for a <12b active parameter model I can use for RP. However, stuff like impish nemo doesn’t work due to lack of tool calling support. Any suggestions? Both MoE and Non MoE works. In case of non MoE, probably want a size around 8b, for MoE, can be like up to 30b

Tool calling is tricky, and not 100% accurate even among huge models.

If it's a top priority, then one of the big Qwen3 models are likely the best option.
For roleplay you might want to try one of huihui's 'abliterated' models.

SicariusSicariiStuff changed discussion status to closed

I will use abliterated qwen coder flash.

Sign up or log in to comment