Upload folder using huggingface_hub

README.md

@@ -5,8 +5,6 @@ base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
 tags:
 - abliterated
 - uncensored
-- autoquant
-- gguf
 ---
 
 # Meta-Llama-3.1-8B-Instruct-abliterated
@@ -15,4 +13,12 @@ tags:
 
 This is an uncensored version of Llama 3.1 8B Instruct created with abliteration (see [this article](https://huggingface.co/blog/mlabonne/abliteration) to know more about it).
 
-Special thanks to [@FailSpy](https://huggingface.co/failspy) for the original code and technique. Please follow him if you're interested in abliterated models.
+Special thanks to [@FailSpy](https://huggingface.co/failspy) for the original code and technique. Please follow him if you're interested in abliterated models.
+
+## ⚡️ Quantization
+
+Thanks to ZeroWw and Apel-sin for the quants.
+
+* **New GGUF**: https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
+* **ZeroWw GGUF**: https://huggingface.co/ZeroWw/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
+* **EXL2**: https://huggingface.co/Apel-sin/llama-3.1-8B-abliterated-exl2

meta-llama-3.1-8b-instruct-abliterated.Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e4cfd12e8e8361d6268cf7f5b115ace2ef902f8ecbf9fb397ad8109327fb0c08
-size 3179131936
+oid sha256:3b127302c4265b3d93623f8e85475d2c5cf2d99f397e822b1ea0dbd9877f4b81
+size 3179131968

meta-llama-3.1-8b-instruct-abliterated.bf16.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ce54c98c6c9650181c9c4b093c8842cd2d959fe14d6b7a4df50dc489301e80b2
-size 16068891680
+oid sha256:ab319a0cbfc9ef0f29a81af2bf8db7a7c92ff746aeef06e4963914dec88d254b
+size 16068891712