Hugging Face's logo

mlx-community
/
KernelLLM-6bit

Text Generation
Transformers
Safetensors
MLX
llama
conversational
text-generation-inference
6-bit
Model card Files Community
Felladrin commited on
Commit
bc3a263
·
verified ·
1 Parent(s): 44b72b4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -9,9 +9,9 @@ tags:
9
  - mlx
10
  ---
11
 
12
- # Felladrin/KernelLLM-mlx-6Bit
13
 
14
- The Model [Felladrin/KernelLLM-mlx-6Bit](https://huggingface.co/Felladrin/KernelLLM-mlx-6Bit) was converted to MLX format from [facebook/KernelLLM](https://huggingface.co/facebook/KernelLLM) using mlx-lm version **0.22.3**.
15
 
16
  ## Use with mlx
17
 
@@ -22,7 +22,7 @@ pip install mlx-lm
22
  ```python
23
  from mlx_lm import load, generate
24
 
25
- model, tokenizer = load("Felladrin/KernelLLM-mlx-6Bit")
26
 
27
  prompt="hello"
28
 
 
9
  - mlx
10
  ---
11
 
12
+ # mlx-community/KernelLLM-6bit
13
 
14
+ The Model [mlx-community/KernelLLM-6bit](https://huggingface.co/mlx-community/KernelLLM-6bit) was converted to MLX format from [facebook/KernelLLM](https://huggingface.co/facebook/KernelLLM) using mlx-lm version **0.22.3**.
15
 
16
  ## Use with mlx
17
 
 
22
  ```python
23
  from mlx_lm import load, generate
24
 
25
+ model, tokenizer = load("mlx-community/KernelLLM-6bit")
26
 
27
  prompt="hello"
28