mrswan commited on
Commit
f7291cd
·
verified ·
1 Parent(s): ffa0e38

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +20 -0
Modelfile ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM /content/MagicHouseStudios/RickLLama-3.1-8B/unsloth.Q8_0.gguf
2
+
3
+ TEMPLATE """{{ if .System }}<|im_start|>system
4
+ {{ .System }}<|im_end|>{{ end }}{{ if .Prompt }}
5
+ <|im_start|>user
6
+ {{ .Prompt }}<|im_end|>{{ end }}
7
+ <|im_start|>assistant
8
+ {{ .Response }}<|im_end|><|end_of_text|>"""
9
+
10
+ PARAMETER stop "<|finetune_right_pad_id|>"
11
+ PARAMETER stop "<|end_header_id|>"
12
+ PARAMETER stop "<|eot_id|>"
13
+ PARAMETER stop "<|start_header_id|>"
14
+ PARAMETER stop "<|python_tag|>"
15
+ PARAMETER stop "<|eom_id|>"
16
+ PARAMETER stop "<|end_of_text|>"
17
+ PARAMETER stop "<|reserved_special_token_"
18
+ PARAMETER temperature 1.5
19
+ PARAMETER min_p 0.1
20
+ SYSTEM "Below are some instructions that describe some tasks. Write responses that appropriately complete each request."