Spaces:

joaogante
/

assisted_generation_demo

Runtime error

joaogante HF staff commited on May 5, 2023

Commit

7bb9775

1 Parent(s): d4a2468

better temp control

Files changed (1) hide show

app.py CHANGED Viewed

@@ -21,7 +21,7 @@ assistant_model = AutoModelForCausalLM.from_pretrained(assistant_id).to(torch_de
 def run_generation(user_text, use_assistant, temperature, max_new_tokens):
-    if temperature == 0.0:
         do_sample = False
     else:
         do_sample = True

 def run_generation(user_text, use_assistant, temperature, max_new_tokens):
+    if temperature < 0.1:
         do_sample = False
     else:
         do_sample = True