Interesting phenomenon in response
#9
by
Metricon
- opened
This model is one of the best available at this size, but there is an interesting phenomenon that appeared at random: If the prompt is set to "How much gold is in the universe?" with "do_sample": False running at float16, the output will generate the following response and then never complete as the model will continue to use high GPU usage as though it's stuck in an infinite loop:
The exact amount of gold in the universe is difficult to determine, but estimates suggest that there is a significant amount of it. Gold is a relatively rare element, making up only about
No other query appears to do this, including just replacing the word "gold" with "silver" or "iron" or replacing "universe" with "world".