system_prompt
Hello experts,
I don't have much experience with LLMs yet, but I'm working on it. :-)
I'm having a problem at the moment and can't find a solution despite two days of searching online:
I use "Chronos-Gold-12B-1.0.Q4_K_M" via the basic web UI in localAI.
But I just can't find a way to set a system_prompt to adapt the model for me.
How and where do you do that?
It would also be interesting to know why there are two yaml files (one of them with .-gallery_ at the beginning).
Thank you very much for your help!
Best regards
Gruenie
There is an example in the model card
<|im_start|>system
A system prompt describing how you'd like your bot to act.<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
I can assist you or we can discuss other things?<|im_end|>
<|im_start|>user
I was wondering how transformers work?<|im_end|>
<|im_start|>assistant
Thank you elinas for your time and the answer.
Of course I saw this example.
My intention was/is to set a system prompt in the configuration file, so that it is always loaded with this model.
But where ever in the yaml-file(s) I tried it, it did not work at all.
I also tried to use the "system_prompt=..." without success.
Maybe you can point me to the exact position in the yaml and how to set.
Btw.: When I install models in localAI with their gallery, then I lways have 2 yaml-files. One always starts with ".gallery" while the other not. Which ist the right file to edit (I tried in both without success).
Thank you again for your help
Gruenie