Update README.md
Browse files
README.md
CHANGED
|
@@ -35,7 +35,14 @@ I used the qwen2.7b.OD.q4_k_m.gguf for my testing and got it to write me a simpl
|
|
| 35 |
|
| 36 |
You can run this model using `vLLM` or `ollama`. The following instructions are for using `ollama`.
|
| 37 |
|
|
|
|
| 38 |
ollama run skratos115/qwen2-7b-opendevin-q4_k_m
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
### Prerequisites
|
| 40 |
|
| 41 |
- Docker
|
|
|
|
| 35 |
|
| 36 |
You can run this model using `vLLM` or `ollama`. The following instructions are for using `ollama`.
|
| 37 |
|
| 38 |
+
q-4k
|
| 39 |
ollama run skratos115/qwen2-7b-opendevin-q4_k_m
|
| 40 |
+
|
| 41 |
+
or
|
| 42 |
+
|
| 43 |
+
f16
|
| 44 |
+
ollama run skratos115/qwen2-7b-opendevin-f16
|
| 45 |
+
|
| 46 |
### Prerequisites
|
| 47 |
|
| 48 |
- Docker
|