DavidAU commited on
Commit
2a0b91a
·
verified ·
1 Parent(s): 7b07b4f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -77,6 +77,11 @@ Model is set at:
77
  - 40k context (the default for the org model)
78
  - CHATML or Jinja template (embedded OR see Jinja notes below)
79
 
 
 
 
 
 
80
  SYSTEM PROMPT:
81
 
82
  You may or may not need to set this:
 
77
  - 40k context (the default for the org model)
78
  - CHATML or Jinja template (embedded OR see Jinja notes below)
79
 
80
+ QUANTS:
81
+
82
+ There are two sets of quants, regular and "MAX" (in the filename) with output tensor set at float16 (16 bit - full precision) to enhance performance
83
+ including reasoning.
84
+
85
  SYSTEM PROMPT:
86
 
87
  You may or may not need to set this: