Kwokou commited on
Commit
3d6f8e5
·
verified ·
1 Parent(s): 7b98325

Upload Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +17 -0
Modelfile ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./mini-spyra-v.1.3-q8_0.gguf
2
+
3
+ TEMPLATE """{{ if .System }}<|im_start|>system
4
+ {{ .System }}<|im_end|>{{ end }}
5
+ <|im_start|>user
6
+ {{ .Prompt }}<|im_end|>
7
+ <|im_start|>assistant
8
+ """
9
+
10
+ PARAMETER temperature 0.7
11
+ PARAMETER num_ctx 8192
12
+ PARAMETER stop "<|system|>"
13
+ PARAMETER stop "<|user|>"
14
+ PARAMETER stop "<|assistant|>"
15
+ PARAMETER stop "</s>"
16
+
17
+ SYSTEM "You are Spyra, a professional AI assistant who gives precise answers."