Add files using upload-large-folder tool
Browse files- .DS_Store +0 -0
- .cache/.DS_Store +0 -0
- README.md +7 -0
.DS_Store
ADDED
|
Binary file (6.15 kB). View file
|
|
|
.cache/.DS_Store
ADDED
|
Binary file (6.15 kB). View file
|
|
|
README.md
CHANGED
|
@@ -14,6 +14,13 @@ This model [sealad886/gpt-oss-120b-MLX-native](https://huggingface.co/sealad886/
|
|
| 14 |
converted to MLX format from [openai/gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b)
|
| 15 |
using mlx-lm version **0.26.3**.
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
## Use with mlx
|
| 18 |
|
| 19 |
```bash
|
|
|
|
| 14 |
converted to MLX format from [openai/gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b)
|
| 15 |
using mlx-lm version **0.26.3**.
|
| 16 |
|
| 17 |
+
> **Note:** command for conversion:
|
| 18 |
+
> ```bash
|
| 19 |
+
> mlx_lm.convert --hf-repo openai/gpt-oss-20b ... -q --q-bits 4
|
| 20 |
+
> ```
|
| 21 |
+
>
|
| 22 |
+
> The version without doing an added 4-bit quant was in a 16-bit format (either bfloat16 or float16, I assume; I didn't check).
|
| 23 |
+
|
| 24 |
## Use with mlx
|
| 25 |
|
| 26 |
```bash
|