tjohn327
/

scion_mistral_7b_gguf_q4km

text-generation-inference

Model card Files Files and versions Community

scion_mistral_7b_gguf_q4km / Modelfile

tjohn327's picture

(Trained with Unsloth)

867c227 verified 3 months ago

history blame contribute delete

219 Bytes


	FROM /content/tjohn327/scion_mistral_7b_gguf_q4km/unsloth.BF16.gguf
	TEMPLATE """[INST] {{ if .System }}{{ .System }} {{ end }}{{ .Prompt }} [/INST]"""
	PARAMETER stop "</s>"
	PARAMETER temperature 1.5
	PARAMETER min_p 0.1