Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
story
writing
fiction
roleplaying
swearing
extreme swearing
rp
graphic horror
horror
nsfw
llama3
Not-For-All-Audiences
mergekit
conversational
Update README.md
Browse files
README.md
CHANGED
@@ -86,6 +86,25 @@ what they "bring" to this merged 16.5B model.
|
|
86 |
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192.
|
87 |
However this can be extended using "rope" settings up to 32k.
|
88 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
89 |
It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
|
90 |
|
91 |
<B>Settings / Known Issue(s) and Fix(es):</b>
|
|
|
86 |
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192.
|
87 |
However this can be extended using "rope" settings up to 32k.
|
88 |
|
89 |
+
Here is the standard LLAMA3 template:
|
90 |
+
|
91 |
+
<PRE>
|
92 |
+
{
|
93 |
+
"name": "Llama 3",
|
94 |
+
"inference_params": {
|
95 |
+
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
|
96 |
+
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
|
97 |
+
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
|
98 |
+
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
|
99 |
+
"pre_prompt_suffix": "<|eot_id|>",
|
100 |
+
"antiprompt": [
|
101 |
+
"<|start_header_id|>",
|
102 |
+
"<|eot_id|>"
|
103 |
+
]
|
104 |
+
}
|
105 |
+
}
|
106 |
+
</PRE>
|
107 |
+
|
108 |
It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
|
109 |
|
110 |
<B>Settings / Known Issue(s) and Fix(es):</b>
|