MLX
English
llama
mc0ps commited on
Commit
9de675b
1 Parent(s): a49f12c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -12,13 +12,18 @@ model-index:
12
  results: []
13
  ---
14
 
15
- # tulu-2-dpo-7b-4bit-mlx
16
  This model was converted to MLX format from [`allenai/tulu-2-dpo-7b`]().
17
  Refer to the [original model card](https://huggingface.co/allenai/tulu-2-dpo-7b) for more details on the model.
18
  ## Use with mlx
 
19
  ```bash
20
- pip install mlx
21
- git clone https://github.com/ml-explore/mlx-examples.git
22
- cd mlx-examples/llms/hf_llm
23
- python generate.py --model mlx-community/tulu-2-dpo-7b-4bit-mlx --prompt "My name is"
 
 
 
 
24
  ```
 
12
  results: []
13
  ---
14
 
15
+ # mlx-community/tulu-2-dpo-7b-4bit-mlx
16
  This model was converted to MLX format from [`allenai/tulu-2-dpo-7b`]().
17
  Refer to the [original model card](https://huggingface.co/allenai/tulu-2-dpo-7b) for more details on the model.
18
  ## Use with mlx
19
+
20
  ```bash
21
+ pip install mlx-lm
22
+ ```
23
+
24
+ ```python
25
+ from mlx_lm import load, generate
26
+
27
+ model, tokenizer = load("mlx-community/tulu-2-dpo-7b-4bit-mlx")
28
+ response = generate(model, tokenizer, prompt="hello", verbose=True)
29
  ```