rkstgr commited on
Commit
7f85ca5
·
verified ·
1 Parent(s): 8233355

Upload Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +17 -0
Modelfile ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./typer-1.5b-instruct.Q8_0.gguf
2
+
3
+ TEMPLATE """{{ if .System }}<|im_start|>system
4
+ {{ .System }}<|im_end|>
5
+ {{ end }}{{ if .Prompt }}<|im_start|>user
6
+ {{ .Prompt }}<|im_end|>
7
+ {{ end }}<|im_start|>assistant
8
+ """
9
+
10
+ PARAMETER stop "<|im_end|>"
11
+ PARAMETER temperature 0.7
12
+ PARAMETER top_p 0.9
13
+ PARAMETER top_k 40
14
+ PARAMETER repeat_penalty 1.1
15
+ PARAMETER num_ctx 4096
16
+
17
+ SYSTEM You are a helpful assistant that provides accurate and detailed answers about Typst, a modern markup language for document preparation.