Lewdiculous
/

InfinityRP-v1-7B-GGUF-IQ-Imatrix

nsfw

Model card Files Files and versions Community

Lewdiculous commited on Apr 17

Commit

6d8cc0c

•

1 Parent(s): 11b91be

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -19,6 +19,8 @@ base_model:
 This repository hosts GGUF-Imatrix quantizations for [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B).
 **What does "Imatrix" mean?**
 It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.

 This repository hosts GGUF-Imatrix quantizations for [Endevor/InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B).
+The supported --contextsize is 8192.
 **What does "Imatrix" mean?**
 It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.