Setting Llama3 response length
#6
by
colourspec
- opened
How can you adjust the length of the responses. To get longer responses, I've tried putting a note under paragraphs to keep response within say 3-4 paragraphs, doesn't work.
- Shorter responses: Decrease response tokens to 200 & turn on trim.
- Longer responses: Increase response tokens & spam the continue button.
Trim Incomplete Sentences
Change Response (tokens)
Enable Quick "Continue" button 
Or enable Auto-Continue
For some reason I didn't have much luck with using 'Continue', tried for like 2 Llama3 models they just refused to output anything with continue (an empty input message would work, not continue)
Manually edit the response, add at least the first letter or word for the next sentence.
colourspec
changed discussion status to
closed