Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,18 @@ tags:
|
|
16 |
|
17 |
This is an uncensored version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
## Usage
|
20 |
You can use this model in your applications by loading it with Hugging Face's `transformers` library:
|
21 |
|
|
|
16 |
|
17 |
This is an uncensored version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
|
18 |
|
19 |
+
## GGUF
|
20 |
+
|
21 |
+
|
22 |
+
[llama.cpp-b6115](https://github.com/ggml-org/llama.cpp/releases/tag/b6115) now supports conversion to GGUF format and can be tested using llama-cli.
|
23 |
+
|
24 |
+
```
|
25 |
+
llama-cli -m huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated/ggml-model-Q4_K_M.gguf -n 8192
|
26 |
+
|
27 |
+
```
|
28 |
+
|
29 |
+
|
30 |
+
|
31 |
## Usage
|
32 |
You can use this model in your applications by loading it with Hugging Face's `transformers` library:
|
33 |
|