Update README.md
Browse files
README.md
CHANGED
@@ -8,7 +8,7 @@ library_name: transformers
|
|
8 |
|
9 |
This is meta-llama/Llama-3-8B-Instruct with orthogonalized bfloat16 safetensor weights, generated with the methodology that was described in the preview paper/blog post: '[Refusal in LLMs is mediated by a single direction](https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction)' which I encourage you to read to understand more.
|
10 |
|
11 |
-
TL;DR: this model has had certain weights manipulated to "inhibit" the model's ability to express refusal. It is not in anyway _guaranteed_ that it won't refuse you, understand your request, it may still lecture you about ethics/safety, etc. It is tuned in all other respects the same as the original
|
12 |
|
13 |
## Quants
|
14 |
[GGUF Quants available here](https://huggingface.co/failspy/Llama-3-8B-Instruct-abliterated-GGUF)
|
|
|
8 |
|
9 |
This is meta-llama/Llama-3-8B-Instruct with orthogonalized bfloat16 safetensor weights, generated with the methodology that was described in the preview paper/blog post: '[Refusal in LLMs is mediated by a single direction](https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction)' which I encourage you to read to understand more.
|
10 |
|
11 |
+
TL;DR: this model has had certain weights manipulated to "inhibit" the model's ability to express refusal. It is not in anyway _guaranteed_ that it won't refuse you, understand your request, it may still lecture you about ethics/safety, etc. It is tuned in all other respects the same as the original 8B instruct model was, just with the strongest refusal direction orthogonalized out.
|
12 |
|
13 |
## Quants
|
14 |
[GGUF Quants available here](https://huggingface.co/failspy/Llama-3-8B-Instruct-abliterated-GGUF)
|