Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+YuLan-Mini-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,170 @@
+---
+license: mit
+library_name: transformers
+pipeline_tag: text-generation
+datasets:
+- yulan-team/YuLan-Mini-Datasets
+- HuggingFaceFW/fineweb-edu
+- bigcode/the-stack-v2
+- mlfoundations/dclm-baseline-1.0
+- math-ai/AutoMathText
+- gair-prox/open-web-math-pro
+- RUC-AIBOX/long_form_thought_data_5k
+- internlm/Lean-Workbook
+- internlm/Lean-Github
+- deepseek-ai/DeepSeek-Prover-V1
+- ScalableMath/Lean-STaR-base
+- ScalableMath/Lean-STaR-plus
+- ScalableMath/Lean-CoT-base
+- ScalableMath/Lean-CoT-plus
+- opencsg/chinese-fineweb-edu
+- liwu/MNBVC
+- vikp/textbook_quality_programming
+- HuggingFaceTB/smollm-corpus
+- OpenCoder-LLM/opc-annealing-corpus
+- OpenCoder-LLM/opc-sft-stage1
+- OpenCoder-LLM/opc-sft-stage2
+- XinyaoHu/AMPS_mathematica
+- deepmind/math_dataset
+- mrfakename/basic-math-10m
+- microsoft/orca-math-word-problems-200k
+- AI-MO/NuminaMath-CoT
+- HuggingFaceTB/cosmopedia
+- MU-NLPC/Calc-ape210k
+- manu/project_gutenberg
+- storytracer/LoC-PD-Books
+- allenai/dolma
+language:
+- en
+- zh
+tags:
+- code
+- math
+- TensorBlock
+- GGUF
+arxiv: 2412.17743
+base_model: yulan-team/YuLan-Mini
+model-index:
+- name: YuLan-Mini
+  results:
+  - task:
+      type: text-generation
+    dataset:
+      name: HumanEval
+      type: openai_humaneval
+    metrics:
+    - type: pass@1
+      value: 0.64
+      name: pass@1
+      verified: false
+  - task:
+      type: text-generation
+    dataset:
+      name: MBPP
+      type: mbpp
+    metrics:
+    - type: pass@1
+      value: 0.659
+      name: pass@1
+      verified: false
+  - task:
+      type: text-generation
+    dataset:
+      name: MATH-500
+      type: math-500
+    metrics:
+    - type: maj@1
+      value: 0.378
+      name: maj@1
+      verified: false
+  - task:
+      type: text-generation
+    dataset:
+      name: GSM8K
+      type: gsm8k
+    metrics:
+    - type: maj@1
+      value: 0.684
+      name: maj@1
+      verified: false
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## yulan-team/YuLan-Mini - GGUF
+
+This repo contains GGUF format model files for [yulan-team/YuLan-Mini](https://huggingface.co/yulan-team/YuLan-Mini).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4823](https://github.com/ggml-org/llama.cpp/commit/5bbe6a9fe9a8796a9389c85accec89dbc4d91e39).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+
+<s>
+
+    <|start_header_id|>system<|end_header_id|>
+
+{system_prompt}<|eot_id|>
+
+    <|start_header_id|>user<|end_header_id|>
+
+{prompt}<|eot_id|>
+
+    <|start_header_id|>assistant<|end_header_id|>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [YuLan-Mini-Q2_K.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q2_K.gguf) | Q2_K | 1.468 GB | smallest, significant quality loss - not recommended for most purposes |
+| [YuLan-Mini-Q3_K_S.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q3_K_S.gguf) | Q3_K_S | 1.463 GB | very small, high quality loss |
+| [YuLan-Mini-Q3_K_M.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q3_K_M.gguf) | Q3_K_M | 1.560 GB | very small, high quality loss |
+| [YuLan-Mini-Q3_K_L.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q3_K_L.gguf) | Q3_K_L | 1.606 GB | small, substantial quality loss |
+| [YuLan-Mini-Q4_0.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q4_0.gguf) | Q4_0 | 1.463 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [YuLan-Mini-Q4_K_S.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q4_K_S.gguf) | Q4_K_S | 1.746 GB | small, greater quality loss |
+| [YuLan-Mini-Q4_K_M.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q4_K_M.gguf) | Q4_K_M | 1.846 GB | medium, balanced quality - recommended |
+| [YuLan-Mini-Q5_0.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q5_0.gguf) | Q5_0 | 1.742 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [YuLan-Mini-Q5_K_S.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q5_K_S.gguf) | Q5_K_S | 1.882 GB | large, low quality loss - recommended |
+| [YuLan-Mini-Q5_K_M.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q5_K_M.gguf) | Q5_K_M | 1.969 GB | large, very low quality loss - recommended |
+| [YuLan-Mini-Q6_K.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q6_K.gguf) | Q6_K | 2.580 GB | very large, extremely low quality loss |
+| [YuLan-Mini-Q8_0.gguf](https://huggingface.co/tensorblock/YuLan-Mini-GGUF/blob/main/YuLan-Mini-Q8_0.gguf) | Q8_0 | 2.580 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/YuLan-Mini-GGUF --include "YuLan-Mini-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/YuLan-Mini-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

YuLan-Mini-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eac2d20df9563a2254b2e3b70ec2ba7514503653843a931caee527c70c491898
+size 1467847520

YuLan-Mini-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:478114f8afb91b6454b7a21bd64d978644ef48e60951f33298a00bca2137b64b
+size 1605903200

YuLan-Mini-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8170e40fa57faa82dbd23cccd0afd45d91eb2b573b7e13c51e1116371b997e47
+size 1559984480

YuLan-Mini-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0e28433a594ecbbb74bd39234d19b7948876c07ff0061ddb16bcc85c4419254e
+size 1462686560

YuLan-Mini-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:615a175886d5597980ff080729748b4c3f667129134cba61b5ce250b461844c7
+size 1462686560

YuLan-Mini-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c4e4f722b92749b7b4f336b412acae5c26d0f121025c0d67da0857ea0419500
+size 1846423520

YuLan-Mini-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c6dd3f761e287da2a529989e514e878077aeb16439e1bf35ba7eeccf577944a7
+size 1746130400

YuLan-Mini-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37133857c840af80338a9824082985ff4da958fbe7876b2ffb96ff147ce99f52
+size 1741914080

YuLan-Mini-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea583299985bf01ce71a0256729996be57692c48ca4b4631c6aa35957dcf60bb
+size 1968619040

YuLan-Mini-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13035e1ea064cb03e6c32a1dfbd4c2238e26c2c09838c367334be080b989fbbd
+size 1881527840

YuLan-Mini-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0446fcef91063fbb3d4dcce9a336fa72c0845dfb5c8dac6c98d9000d5715b0b6
+size 2579596640

YuLan-Mini-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8f595e258272b84c867d0e1c8e6f6d7759c0e73fbf98b32ba3a8fb9c6ece9db
+size 2579596640