Add 'Recommended Inference Parameters' section
Browse files
README.md
CHANGED
@@ -80,3 +80,10 @@ inference:
|
|
80 |
{message}<|im_end|>
|
81 |
<|im_start|>assistant
|
82 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
80 |
{message}<|im_end|>
|
81 |
<|im_start|>assistant
|
82 |
```
|
83 |
+
|
84 |
+
## Recommended Inference Parameters
|
85 |
+
|
86 |
+
```yml
|
87 |
+
penalty_alpha: 0.5
|
88 |
+
top_k: 5
|
89 |
+
```
|