kingbri commited on
Commit
4ae49d2
1 Parent(s): b516fd9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -30,15 +30,15 @@ If you don't have huggingface-cli, please run `pip install huggingface_hub`.
30
 
31
  To run this model, follow these steps:
32
 
33
- 1. Make a directory inside your models folder called `Kimiko-10.7B-v3`
34
 
35
  2. Open a terminal inside your models folder
36
 
37
- 3. Run `huggingface-cli download royallab/Kimiko-10.7B-v3 --revision 4bpw --local-dir Kimiko-10.7B-v3 --local-dir-use-symlinks False`
38
 
39
  1. The `--revision` flag corresponds to the branch name on the model repo. Please select the appropriate bpw branch for your system.
40
 
41
- 4. Inside TabbyAPI's config.yml, set `model_name` to `Kimiko-10.7B-v3` or you can use the `/model/load` endpoint after launching.
42
 
43
  5. Launch TabbyAPI inside your python env by running `python main.py`
44
 
 
30
 
31
  To run this model, follow these steps:
32
 
33
+ 1. Make a directory inside your models folder called `Kimiko-10.7B-v3-exl2`
34
 
35
  2. Open a terminal inside your models folder
36
 
37
+ 3. Run `huggingface-cli download royallab/Kimiko-10.7B-v3-exl2 --revision 4bpw --local-dir Kimiko-10.7B-v3-exl2 --local-dir-use-symlinks False`
38
 
39
  1. The `--revision` flag corresponds to the branch name on the model repo. Please select the appropriate bpw branch for your system.
40
 
41
+ 4. Inside TabbyAPI's config.yml, set `model_name` to `Kimiko-10.7B-v3-exl2` or you can use the `/model/load` endpoint after launching.
42
 
43
  5. Launch TabbyAPI inside your python env by running `python main.py`
44