DavidAU commited on
Commit
2f81ca6
·
verified ·
1 Parent(s): f18eee7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -86,6 +86,25 @@ what they "bring" to this merged 16.5B model.
86
  This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192.
87
  However this can be extended using "rope" settings up to 32k.
88
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
89
  It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
90
 
91
  <B>Settings / Known Issue(s) and Fix(es):</b>
 
86
  This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 8k / 8192.
87
  However this can be extended using "rope" settings up to 32k.
88
 
89
+ Here is the standard LLAMA3 template:
90
+
91
+ <PRE>
92
+ {
93
+ "name": "Llama 3",
94
+ "inference_params": {
95
+ "input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
96
+ "input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
97
+ "pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
98
+ "pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
99
+ "pre_prompt_suffix": "<|eot_id|>",
100
+ "antiprompt": [
101
+ "<|start_header_id|>",
102
+ "<|eot_id|>"
103
+ ]
104
+ }
105
+ }
106
+ </PRE>
107
+
108
  It is also known, that the "Command-R" template will work too, and will result in radically different prose/output.
109
 
110
  <B>Settings / Known Issue(s) and Fix(es):</b>