mlx-community
/

YandexGPT-5-Lite-8B-pretrain-Q8-mlx

8-bit precision

Model card Files Files and versions Community

valeriylo commited on about 13 hours ago

Commit

cabb319

·

verified ·

1 Parent(s): d7c6d0f

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -10,9 +10,9 @@ tags:
 - mlx
 ---
-# valeriylo/YandexGPT-5-Lite-8B-pretrain-Q8-mlx
-The Model [valeriylo/YandexGPT-5-Lite-8B-pretrain-Q8-mlx](https://huggingface.co/valeriylo/YandexGPT-5-Lite-8B-pretrain-Q8-mlx) was converted to MLX format from [yandex/YandexGPT-5-Lite-8B-pretrain](https://huggingface.co/yandex/YandexGPT-5-Lite-8B-pretrain) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -23,7 +23,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("valeriylo/YandexGPT-5-Lite-8B-pretrain-Q8-mlx")
 prompt="hello"

 - mlx
 ---
+# mlx-community/YandexGPT-5-Lite-8B-pretrain-Q8-mlx
+The Model [mlx-community/YandexGPT-5-Lite-8B-pretrain-Q8-mlx](https://huggingface.co/mlx-community/YandexGPT-5-Lite-8B-pretrain-Q8-mlx) was converted to MLX format from [yandex/YandexGPT-5-Lite-8B-pretrain](https://huggingface.co/yandex/YandexGPT-5-Lite-8B-pretrain) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/YandexGPT-5-Lite-8B-pretrain-Q8-mlx")
 prompt="hello"