Fantastic model but
#2
by
zhuregson
- opened
I'm using this model on lmstudios, and the messages can get very very long. i've tried using ooc to reduce messages to below 200 or 300 words, but it doesn't seem to work right. i've had to reduce token count instead, but it cuts it off mid sentence. any thoughts on what i can do? thanks.
Hey there! Glad you like the model.
I do not think it's possible to do instructions (OOC) properly (using the correct message header) in LMStudio, so that's likely why it did not work.
Instead, you can also control the message length using ## Writing Style section in system prompt. See here for details:
- https://huggingface.co/dreamgen/lucid-v1-nemo#controlling-response-length
- https://huggingface.co/dreamgen/lucid-v1-nemo#structured-scenario-information
Reducing token count has no effect on the output style -- it just stops the model after N tokens, which explains why it gets cut off.