Hugging Face's logo

TheBloke
/
LongChat-7B-GPTQ

Text Generation
Transformers
Safetensors
llama
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files Community
TheBloke commited on
Commit
d87af07
•
1 Parent(s): 91f72b5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -23,7 +23,7 @@ These files are GPTQ 4bit model files for [LmSys' Long Chat 7B](https://huggingf
23
 
24
  It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
25
 
26
- **This GPTQ which offers up to 16K context size**
27
 
28
  The increased context is tested to work with [ExLlama](https://github.com/turboderp/exllama), via the latest release of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
29
 
 
23
 
24
  It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
25
 
26
+ **This iGPTQ offers up to 16K context size**
27
 
28
  The increased context is tested to work with [ExLlama](https://github.com/turboderp/exllama), via the latest release of [text-generation-webui](https://github.com/oobabooga/text-generation-webui).
29