Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Smaug-34B-v0.1_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Smaug-34B-v0.1_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Smaug-34B-v0.1_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Smaug-34B-v0.1_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Smaug-34B-v0.1_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,33 @@
+---
+license: other
+license_name: yi-license
+license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
+base_model: jondurbin/bagel-34b-v0.2
+---
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png)
+
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/e4u8VYfDBh11u60rFYJHF.png)
+
+This model is a finetune of jondurbin's excellent [bagel](https://huggingface.co/jondurbin/bagel-34b-v0.2) model.
+It has been trained with new datasets and a new technique, which we will share to the community soon.
+This model has not utilised any form of merging.
+
+### Evaluation Results
+
+| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
+| --- | --- | --- | --- | --- | --- | --- |
+|  77.29  | 74.23 | 86.76  | 76.66 | 70.22 | 83.66 | 72.18 |
+
+### Contamination Results
+
+With reference model jondurbin/bagel-34b-v0.2:
+
+| ARC | TruthfulQA | GSM8K |
+| --- | --- | --- |
+| 0.08| 0.38| 0.88|
+
+***
+
+Vanilla Quantization by [nold](https://huggingface.co/nold), Original Model [abacusai/Smaug-34B-v0.1](https://huggingface.co/abacusai/Smaug-34B-v0.1). Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline - 465d7970507dcaac4cb50221157a68c840965774 

Smaug-34B-v0.1_Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d7b71bd353d0808244d81f96684fc1cb6815b7bbdcc2316ea5e8ab41403e088
+size 12825233984

Smaug-34B-v0.1_Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6c3691d6002ff9f9c0d5b072ba988d90301c714ad5b8c0f26120fd8383be821
+size 20658711104

Smaug-34B-v0.1_Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9c02730d15f5ea3b48a7552659710bdee922955d97d51df0a61fd064f665392
+size 24321845824

Smaug-34B-v0.1_Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3f124ad825338a03d918b9c5a96892cd3b1e4eef2c5c9e07fdfd4ef8411fb15
+size 28213926464

Smaug-34B-v0.1_Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bcbe493fb02a0edc16f63bba5a81afb94c183f1112fee761d0b7cfb05e13862d
+size 36542282304