Hello there, 
text
Hello there, 
new_line
new_line
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
text
New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
new_line
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
text
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).
new_line
new_line
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
text
The model was trained on 9M Claude conversations ONLY, giving him another writting style.
new_line
new_line
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude
Undi95/Meta-Llama-3.1-8B-Claude
model
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude
 > OG release fp32, it's the epoch 2
text
 > OG release fp32, it's the epoch 2
new_line
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16
Undi95/Meta-Llama-3.1-8B-Claude-bf16
model
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16
 > Base model resharded in bf16 waiting for available quant without issues
text
 > Base model resharded in bf16 waiting for available quant without issues
new_line
new_line
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
text
Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.
new_line
new_line
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
model
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total
 > Uncensored model, refuse 68 times on 3000 toxic prompt
text
 > Uncensored model, refuse 68 times on 3000 toxic prompt
new_line
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
model
resource
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total
 > Uncensored model, refuse 39 times on 3000 toxic prompt
text
 > Uncensored model, refuse 39 times on 3000 toxic prompt
new_line
new_line
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
text
It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.
new_line
new_line
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
text
I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
Hello there, 

New model released, my goal was to try finetune on the last Llama-3.1-8B-Instruct but not a small train, I wanted to do something useful.
One of the rare model that I didn't made for RP, or in the goal to uncensor it (but I did anyway kek).

The model was trained on 9M Claude conversations ONLY, giving him another writting style.

https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude > OG release fp32, it's the epoch 2
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-bf16 > Base model resharded in bf16 waiting for available quant without issues

Since it's frustrating to be censored using a local model, orthogonal activation steering was used, trying to force the model to never refuse a prompt.

https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-68fail-3000total > Uncensored model, refuse 68 times on 3000 toxic prompt
https://huggingface.co/Undi95/Meta-Llama-3.1-8B-Claude-39fail-3000total > Uncensored model, refuse 39 times on 3000 toxic prompt

It still refuse some prompt but the majority of them is uncensored. OAS can make a model more dumb or make the base perplexity go higher, so I didn't snipe for 0 refusal.

I don't do non-RP model a lot so any feedback is welcome, I would like to re-use this base for some others future project if needed.
❤️
Chief-Inspector MarinaraSpaghetti Herman555 John6666 AtonMountlook Ramikan-BR DuckyBlender osanseviero mambiux den0620 win10
666627d86cd2ef174a6e2257
https://cdn-avatars.huggingface.co/v1/production/uploads/666627d86cd2ef174a6e2257/QVRd7WN6kVCtT5BDpf8vq.png
Invisietch
invisietch
user
63ab1241ad514ca8d1430003
https://cdn-avatars.huggingface.co/v1/production/uploads/63ab1241ad514ca8d1430003/d-43TcOxG-zqAbzrH2m7H.png
Undi
Undi95
user
66247dbda8d1362ebc5603fe
/avatars/18daa2d580f5f35cf850bc9df8a03755.svg
Sporkness
SporkySporkness
user