Upload folder using huggingface_hub

.gitattributes

@@ -34,3 +34,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 apriel-5b-instruct-llamafied-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
+model.shard-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,53 +1,5 @@
 ---
-base_model: mrfakename/Apriel-5B-Instruct-llamafied
-library_name: transformers
-license: mit
-pipeline_tag: text-generation
-tags:
-- llama-cpp
-- gguf-my-repo
+base_model: Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF
 ---
 
-# Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF
-This model was converted to GGUF format from [`mrfakename/Apriel-5B-Instruct-llamafied`](https://huggingface.co/mrfakename/Apriel-5B-Instruct-llamafied) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
-Refer to the [original model card](https://huggingface.co/mrfakename/Apriel-5B-Instruct-llamafied) for more details on the model.
-
-## Use with llama.cpp
-Install llama.cpp through brew (works on Mac and Linux)
-
-```bash
-brew install llama.cpp
-
-```
-Invoke the llama.cpp server or the CLI.
-
-### CLI:
-```bash
-llama-cli --hf-repo Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF --hf-file apriel-5b-instruct-llamafied-q4_k_s.gguf -p "The meaning to life and the universe is"
-```
-
-### Server:
-```bash
-llama-server --hf-repo Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF --hf-file apriel-5b-instruct-llamafied-q4_k_s.gguf -c 2048
-```
-
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
-
-Step 1: Clone llama.cpp from GitHub.
-```
-git clone https://github.com/ggerganov/llama.cpp
-```
-
-Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
-```
-cd llama.cpp && LLAMA_CURL=1 make
-```
-
-Step 3: Run inference through the main binary.
-```
-./llama-cli --hf-repo Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF --hf-file apriel-5b-instruct-llamafied-q4_k_s.gguf -p "The meaning to life and the universe is"
-```
-or 
-```
-./llama-server --hf-repo Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF --hf-file apriel-5b-instruct-llamafied-q4_k_s.gguf -c 2048
-```
+Sharded GGUF version of [Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF](https://huggingface.co/Felladrin/Apriel-5B-Instruct-llamafied-Q4_K_S-GGUF).

model.shard-00001-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72c8e7b2c6f3fac3dc2196963c7d85cda96a55f3c6c94bb440be1b3a9f45bca1
+size 448279424

model.shard-00002-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e97c7df3266326c49ef1f7e379421c3580b4a6e56a86ddab653f64fcdd0b796d
+size 443614368

model.shard-00003-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f604567c0c357465812ad5d4649338ac26c822449649dd3363064caf72e4bcc3
+size 439536736

model.shard-00004-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba4b77d249af78b438334bfbeafedae7b8bc3e1a7c134141e46081cc3b1339ab
+size 434310336

model.shard-00005-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5dd142771259e78df43bad4177a6b3c53d13d2da6f0c1b6bc8cc8ac4b0fafceb
+size 443747488

model.shard-00006-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6a0f0cf90071e12637b8a565700a1d17841ab7c48a61d9723cbb840cd2158eb
+size 446106848

model.shard-00007-of-00007.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9d7bb040ebe24b9eb3016cb1ba7ccd099601f61d5b1070767c1de74a2c32427
+size 224216672