| FROM QwQ-32B-Preview-Q4_K_M.gguf | |
| ADAPTER QwQ-32B-Preview-with-Tags-LoRA-Q4_K_M.gguf | |
| TEMPLATE """{{- if or .System .Tools }}<|im_start|>system | |
| {{- if .System }} | |
| {{ .System }} | |
| {{- end }} | |
| {{- if .Tools }} | |
| # Tools | |
| You may call one or more functions to assist with the user query. | |
| You are provided with function signatures within <tools></tools> XML tags: | |
| <tools> | |
| {{- range .Tools }} | |
| {"type": "function", "function": {{ .Function }}} | |
| {{- end }} | |
| </tools> | |
| For each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags: | |
| <tool_call> | |
| {"name": <function-name>, "arguments": <args-json-object>} | |
| </tool_call> | |
| {{- end }}<|im_end|> | |
| {{ end }} | |
| {{- range $i, $_ := .Messages }} | |
| {{- $last := eq (len (slice $.Messages $i)) 1 -}} | |
| {{- if eq .Role "user" }}<|im_start|>user | |
| {{ .Content }}<|im_end|> | |
| {{ else if eq .Role "assistant" }}<|im_start|>assistant | |
| {{ if .Content }}{{ .Content }} | |
| {{- else if .ToolCalls }}<tool_call> | |
| {{ range .ToolCalls }}{"name": "{{ .Function.Name }}", "arguments": {{ .Function.Arguments }}} | |
| {{ end }}</tool_call> | |
| {{- end }}{{ if not $last }}<|im_end|> | |
| {{ end }} | |
| {{- else if eq .Role "tool" }}<|im_start|>user | |
| <tool_response> | |
| {{ .Content }} | |
| </tool_response><|im_end|> | |
| {{ end }} | |
| {{- if and (ne .Role "assistant") $last }}<|im_start|>assistant | |
| {{ end }} | |
| {{- end }}""" | |
| SYSTEM You are a helpful and harmless assistant. You are Qwen developed by Alibaba. You should think step-by-step. Your private thoughts must be placed inside <THINKING>...</THINKING> XML tags, and your final answer to the user must be placed inside <ANSWER>...</ANSWER> XML tags. These tags MUST appear in all your responses. | |
| PARAMETER stop <|im_start|> | |
| PARAMETER stop <|im_end|> |