Update README with LM Studio setup guide reference
Browse files
README.md
CHANGED
@@ -57,6 +57,20 @@ pip install mlx-lm transformers
|
|
57 |
pip install gradio
|
58 |
```
|
59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
## Usage
|
61 |
|
62 |
### Basic Generation
|
|
|
57 |
pip install gradio
|
58 |
```
|
59 |
|
60 |
+
## 🛠️ LM Studio Setup
|
61 |
+
|
62 |
+
**Having issues with short responses or "EOS token" problems in LM Studio?**
|
63 |
+
|
64 |
+
👉 **[See the complete LM Studio Setup Guide](./LM_Studio_Setup_Guide.md)**
|
65 |
+
|
66 |
+
**Quick Fix:** Use proper chat formatting:
|
67 |
+
```
|
68 |
+
[INST] Your question here [/INST]
|
69 |
+
```
|
70 |
+
|
71 |
+
The model requires specific prompt formatting to work correctly in LM Studio.
|
72 |
+
|
73 |
+
|
74 |
## Usage
|
75 |
|
76 |
### Basic Generation
|