huihui-ai commited on
Commit
2b512ee
·
verified ·
1 Parent(s): 2ed87f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -16,6 +16,18 @@ tags:
16
 
17
  This is an uncensored version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
18
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ## Usage
20
  You can use this model in your applications by loading it with Hugging Face's `transformers` library:
21
 
 
16
 
17
  This is an uncensored version of [unsloth/gpt-oss-20b-BF16](https://huggingface.co/unsloth/gpt-oss-20b-BF16) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
18
 
19
+ ## GGUF
20
+
21
+
22
+ [llama.cpp-b6115](https://github.com/ggml-org/llama.cpp/releases/tag/b6115) now supports conversion to GGUF format and can be tested using llama-cli.
23
+
24
+ ```
25
+ llama-cli -m huihui-ai/Huihui-gpt-oss-20b-BF16-abliterated/ggml-model-Q4_K_M.gguf -n 8192
26
+
27
+ ```
28
+
29
+
30
+
31
  ## Usage
32
  You can use this model in your applications by loading it with Hugging Face's `transformers` library:
33