PEFT
GGUF
llama-cpp
gguf-my-lora
FringeFields commited on
Commit
d66e28a
·
verified ·
1 Parent(s): a52c2b8

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: FringeFields/mtg-ai-llama-3.3-70b-adapter
3
+ library_name: peft
4
+ license: mit
5
+ datasets:
6
+ - FringeFields/MTG-EDH-Combos-QA
7
+ - FringeFields/MTG-Rules-QA
8
+ - FringeFields/MTG-Cards-QA
9
+ tags:
10
+ - llama-cpp
11
+ - gguf-my-lora
12
+ ---
13
+
14
+ # FringeFields/mtg-ai-llama-3.3-70b-adapter-Q8_0-GGUF
15
+ This LoRA adapter was converted to GGUF format from [`FringeFields/mtg-ai-llama-3.3-70b-adapter`](https://huggingface.co/FringeFields/mtg-ai-llama-3.3-70b-adapter) via the ggml.ai's [GGUF-my-lora](https://huggingface.co/spaces/ggml-org/gguf-my-lora) space.
16
+ Refer to the [original adapter repository](https://huggingface.co/FringeFields/mtg-ai-llama-3.3-70b-adapter) for more details.
17
+
18
+ ## Use with llama.cpp
19
+
20
+ ```bash
21
+ # with cli
22
+ llama-cli -m base_model.gguf --lora mtg-ai-llama-3.3-70b-adapter-q8_0.gguf (...other args)
23
+
24
+ # with server
25
+ llama-server -m base_model.gguf --lora mtg-ai-llama-3.3-70b-adapter-q8_0.gguf (...other args)
26
+ ```
27
+
28
+ To know more about LoRA usage with llama.cpp server, refer to the [llama.cpp server documentation](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md).