second-state
/

Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation

Model card Files Files and versions Community

apepkuss79 commited on Sep 20, 2024

Commit

36eeaa6

·

verified ·

1 Parent(s): a15e276

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -65,7 +65,7 @@ tags:
 - Context size: `128000`
-<!-- - Run as LlamaEdge service
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-Coder-7B-Instruct-Q5_K_M.gguf \
@@ -82,7 +82,7 @@ tags:
     llama-chat.wasm \
     --prompt-template qwen-2.5-coder \
     --ctx-size 128000
-  ``` -->
 ## Quantized GGUF Models

 - Context size: `128000`
+- Run as LlamaEdge service
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Qwen2.5-Coder-7B-Instruct-Q5_K_M.gguf \
     llama-chat.wasm \
     --prompt-template qwen-2.5-coder \
     --ctx-size 128000
+  ```
 ## Quantized GGUF Models