Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text

MagTie-v1-12B.Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:556e6b50ef5ab011ce8cd0b78db60350d4c55ad3d2c8b5235647a920b8039e58
+size 7071700384

MagTie-v1-12B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4623dd38923c6ac85c6f2afabff5e37cb36b371d906c1a37ec1f0b36a78c7702
+size 7477204384

MagTie-v1-12B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:473a73d0fe27b805c964f673f14ce7ff826c6a0eb8c6e0f2cd2cc1ecd81ace95
+size 8727631264

MagTie-v1-12B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ae801ac83b4baaab83349d8cc6a18a2622d566d66d003ddb2d6bcb0e5308bff
+size 10056209824

MagTie-v1-12B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e15b0e0a1c0ff77ea911751572c21939d4f1df55c1cd070c09b64d59877e612
+size 13022369184

README.md

@@ -0,0 +1,23 @@
+---
+base_model: grimjim/MagTie-v1-12B
+base_model_relation: quantized
+quanted_by: grimjim
+library_name: transformers
+license: apache-2.0
+pipeline_tag: text-generation
+tags:
+- mergekit
+- merge
+- GGUF
+---
+# MagTie-v1-12B-GGUF
+
+This repo is a set of GGUF quants of a [grimjim/MagTie-v1-12B](https://huggingface.co/grimjim/MagTie-v1-12B), a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+[llama.cpp](https://github.com/ggerganov/llama.cpp/) was used to make the following quants:
+
+- [Q4_0](MagTie-v1-12B.Q4_0.gguf)
+- [Q4_K_M](MagTie-v1-12B.Q4_K_M.gguf)
+- [Q5_K_M](MagTie-v1-12B.Q5_K_M.gguf)
+- [Q6_K](MagTie-v1-12B.Q6_K.gguf)
+- [Q8_0](MagTie-v1-12B.Q8_0.gguf)