Update README.md
Browse files
README.md
CHANGED
|
@@ -187,6 +187,11 @@ def run_turna_gguf(prompt="Bir varmış bir yokmuş, ", temperature=1, quantizat
|
|
| 187 |
- The path to the configuration file containing model-specific settings.
|
| 188 |
- **model_id** (`str`, default: "helizac/TURNA_GGUF"):
|
| 189 |
- The identifier for the model in the Hugging Face repository.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 190 |
|
| 191 |
## Thanks, and how to contribute
|
| 192 |
|
|
|
|
| 187 |
- The path to the configuration file containing model-specific settings.
|
| 188 |
- **model_id** (`str`, default: "helizac/TURNA_GGUF"):
|
| 189 |
- The identifier for the model in the Hugging Face repository.
|
| 190 |
+
|
| 191 |
+
## Feature Works
|
| 192 |
+
|
| 193 |
+
1 - Currently, TURNA_GGUF only supports CPU usage. Looking to implement it for CUDA support. An issue has already opened and if it's fixed I am going to implement it -> https://github.com/huggingface/candle/issues/2266
|
| 194 |
+
2 - Lots of other dependencies came with huggingface/candle framework and the compiling time can take a very long time. Must write a simplified version to run only quantized-t5 models.
|
| 195 |
|
| 196 |
## Thanks, and how to contribute
|
| 197 |
|