grimjim/llama-3-Nephilim-v3-8B
Text Generation
•
Updated
•
628
•
11
My "greatest hits", sort of
Note Proof of concept that a text completion model, based on Instruct in this case, doesn't need any fine-tuning specifically targeting roleplay. All merge components are academic in origin.
Note Llama 3.1 8B "abliterated" via transfer of the feature via a LoRA. There's probably some damage to the model that could be fixed with additional fine-tuning, as that's a common consequence of abliteration.
Note The LoRA adapter obtained from Llama 3, and later applied against Llama 3.1.
Note One of my first merges, combining two smart models with a roleplay-oriented merge. Someone on YouTube called out this Mistral v0.1 7B architecture model in a video.