Spaces:

poscye
/

ddg-web-search-chat

Running on Zero

pabloce commited on May 23, 2024

Commit

c52d4d8

verified ·

1 Parent(s): 9dab02a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -126,7 +126,7 @@ def respond(
     llm = Llama(
         model_path=f"models/{model}",
-        flash_attn=True,
         n_threads=40,
         n_gpu_layers=81,
         n_batch=1024,

     llm = Llama(
         model_path=f"models/{model}",
+        flash_attn=False,
         n_threads=40,
         n_gpu_layers=81,
         n_batch=1024,