Update README.md
Browse files
README.md
CHANGED
@@ -371,7 +371,7 @@ huggingface-cli download \
|
|
371 |
You can serve the model locally with [LMStudio](https://lmstudio.ai/).
|
372 |
* Download [LM Studio](https://lmstudio.ai/) and install it
|
373 |
* Install `lms cli ~/.lmstudio/bin/lms bootstrap`
|
374 |
-
* In a bash terminal, run `lms import devstralQ4_K_M.
|
375 |
* Open the LMStudio application, click the terminal icon to get into the developer tab. Click select a model to load and select Devstral Q4 K M. Toggle the status button to start the model, in setting oggle Serve on Local Network to be on.
|
376 |
* On the right tab, you will see an API identifier which should be devstralq4_k_m and an api address under API Usage. Keep note of this address, we will use it in the next step.
|
377 |
|
|
|
371 |
You can serve the model locally with [LMStudio](https://lmstudio.ai/).
|
372 |
* Download [LM Studio](https://lmstudio.ai/) and install it
|
373 |
* Install `lms cli ~/.lmstudio/bin/lms bootstrap`
|
374 |
+
* In a bash terminal, run `lms import devstralQ4_K_M.gguf` in the directory where you've downloaded the model checkpoint (e.g. `mistralai/Devstral-Small-2505_gguf`)
|
375 |
* Open the LMStudio application, click the terminal icon to get into the developer tab. Click select a model to load and select Devstral Q4 K M. Toggle the status button to start the model, in setting oggle Serve on Local Network to be on.
|
376 |
* On the right tab, you will see an API identifier which should be devstralq4_k_m and an api address under API Usage. Keep note of this address, we will use it in the next step.
|
377 |
|