Spaces:

poscye
/

ddg-web-search-chat

Running on Zero

pabloce commited on May 27, 2024

Commit

de25d4e

verified ·

1 Parent(s): 2030d72

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -134,7 +134,6 @@ def respond(
     llm = Llama(
         model_path=f"models/{model}",
         flash_attn=True,
-        n_threads=40,
         n_gpu_layers=81,
         n_batch=1024,
         n_ctx=get_context_by_model(model),

     llm = Llama(
         model_path=f"models/{model}",
         flash_attn=True,
         n_gpu_layers=81,
         n_batch=1024,
         n_ctx=get_context_by_model(model),