In text-generation-webui I don't see where to set the LOADER to ExLlama
#1
by
cleverest
- opened
What loader? Where is that selection even at? Do I need to install ExLlama in some way first to choose this? Thank you.
It's on the Model page in text-generation-webui - see Step 1: "Click the Model tab"
If you are using the text-generation-webui one-click-installer then ExLlama should already be installed for you. If not, select it in the UI and there will be a link to click for manual install instructions.
I had to reinstall text-generation-webui to get the latest version with the loader menu. It's all good now! Thanks!