Recommended settings?
#2
by
elpirater312
- opened
What are the recommended settings for temperature, top-p, top-k, min-p, repeat penalty and so on?
this is the best i was able to find from their github page
--temp 0.6 --top-k 20 --top-p 0.95
https://github.com/SJTU-IPADS/PowerInfer/tree/main/smallthinker