|
|
--- |
|
|
license: other |
|
|
license_name: qwen |
|
|
license_link: https://huggingface.co/Qwen/Qwen2.5-Math-72B-Instruct/blob/main/LICENSE |
|
|
pipeline_tag: text-generation |
|
|
base_model: Qwen/Qwen2.5-Math-72B-Instruct |
|
|
base_model_relation: quantized |
|
|
tags: |
|
|
- math |
|
|
- chat |
|
|
- 6bit |
|
|
- apple |
|
|
language: |
|
|
- en |
|
|
- zh |
|
|
library_name: mlx |
|
|
--- |
|
|
# Qwen2.5 Math 72B Instruct 6-bit MLX |
|
|
MLX version of **Qwen2.5 Math 72B Instruct** |
|
|
|
|
|
This model was converted to MLX format from [`https://huggingface.co/Qwen/Qwen2.5-Math-72B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-Math-72B-Instruct) using mlx-lm version **0.22.5**. |
|
|
|
|
|
## Model Details |
|
|
|
|
|
|
|
|
For more details, please refer to [blog post](https://qwenlm.github.io/blog/qwen2.5-math/) and [GitHub repo](https://github.com/QwenLM/Qwen2.5-Math). |
|
|
|
|
|
|
|
|
## Use with mlx |
|
|
|
|
|
```bash |
|
|
pip install -U mlx-lm |
|
|
``` |
|
|
|
|
|
```bash |
|
|
python -m mlx_lm.generate --model TheCluster/Qwen2.5-Math-72B-Instruct-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Find the value of $x$ that satisfies the equation $4x+5 = 6x+7$." |
|
|
``` |
