WizardLM-2-8x22B abliteration inquiry

#1
by OrangeApples - opened

@failspy saw this model https://huggingface.co/fearlessdots/WizardLM-2-7B-abliterated and it made me wonder if it's big brother would benefit from this technique as well.

This tweet https://x.com/WizardLM_AI/status/1780101465950105775 possibly suggests that it's already more uncensored than the other Microsoft models, but perhaps abliteration can take this a step further. If you think it would, would you be willing to make a WizardLM-2-8x22B-abliterated-v3?

Owner

You'll note how I started the README of this one specifically ;)

Nice! Didn't notice that before πŸ‘€

OrangeApples changed discussion status to closed

Sign up or log in to comment