Spaces:

joaogante
/

assisted_generation_demo

Runtime error

joaogante HF staff commited on May 5, 2023

Commit

b147c55

1 Parent(s): 7bb9775

add disclaimer

Files changed (1) hide show

app.py CHANGED Viewed

@@ -63,7 +63,9 @@ with gr.Blocks() as demo:
     gr.Markdown(
         "# 🤗 Assisted Generation Demo\n"
         f"- Model: {model_id} (using INT8)\n"
-        f"- Assistant Model: {assistant_id}"
     )
     with gr.Row():

     gr.Markdown(
         "# 🤗 Assisted Generation Demo\n"
         f"- Model: {model_id} (using INT8)\n"
+        f"- Assistant Model: {assistant_id}\n"
+        "- Disclaimer: due to INT8 quantization and the use of causal masking in assisted generation, the output "
+        "of greedy decoding may differ in rare occasions."
     )
     with gr.Row():