rk2357281 commited on
Commit
32439bd
·
verified ·
1 Parent(s): 7318879

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - unsloth
5
+ - trl
6
+ - sft
7
+ - llama-cpp
8
+ - gguf-my-lora
9
+ base_model: rk2357281/DeepSeek-R1-Medical-COT1
10
+ ---
11
+
12
+ # rk2357281/DeepSeek-R1-Medical-COT1-F16-GGUF
13
+ This LoRA adapter was converted to GGUF format from [`rk2357281/DeepSeek-R1-Medical-COT1`](https://huggingface.co/rk2357281/DeepSeek-R1-Medical-COT1) via the ggml.ai's [GGUF-my-lora](https://huggingface.co/spaces/ggml-org/gguf-my-lora) space.
14
+ Refer to the [original adapter repository](https://huggingface.co/rk2357281/DeepSeek-R1-Medical-COT1) for more details.
15
+
16
+ ## Use with llama.cpp
17
+
18
+ ```bash
19
+ # with cli
20
+ llama-cli -m base_model.gguf --lora DeepSeek-R1-Medical-COT1-f16.gguf (...other args)
21
+
22
+ # with server
23
+ llama-server -m base_model.gguf --lora DeepSeek-R1-Medical-COT1-f16.gguf (...other args)
24
+ ```
25
+
26
+ To know more about LoRA usage with llama.cpp server, refer to the [llama.cpp server documentation](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md).