mlx-community
/

Llama-3.2-3B-Instruct-uncensored-6bit

Text Generation

text-generation-inference

Model card Files Files and versions Community

Felladrin commited on 5 days ago

Commit

3aba7ae

·

verified ·

1 Parent(s): d9a703d

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -6,9 +6,9 @@ tags:
 base_model: chuanli11/Llama-3.2-3B-Instruct-uncensored
 ---
-# Felladrin/Llama-3.2-3B-Instruct-uncensored-mlx-6Bit
-The Model [Felladrin/Llama-3.2-3B-Instruct-uncensored-mlx-6Bit](https://huggingface.co/Felladrin/Llama-3.2-3B-Instruct-uncensored-mlx-6Bit) was converted to MLX format from [chuanli11/Llama-3.2-3B-Instruct-uncensored](https://huggingface.co/chuanli11/Llama-3.2-3B-Instruct-uncensored) using mlx-lm version **0.22.3**.
 ## Use with mlx
@@ -19,7 +19,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/Llama-3.2-3B-Instruct-uncensored-mlx-6Bit")
 prompt="hello"

 base_model: chuanli11/Llama-3.2-3B-Instruct-uncensored
 ---
+# mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit
+The Model [mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit](https://huggingface.co/mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit) was converted to MLX format from [chuanli11/Llama-3.2-3B-Instruct-uncensored](https://huggingface.co/chuanli11/Llama-3.2-3B-Instruct-uncensored) using mlx-lm version **0.22.3**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit")
 prompt="hello"