README.md

metadata

license: other
language:
  - en

ExLlamaV2 Models of Gryphe's MythoMax L2 13B.

Other quantized models are available from TheBloke: GGML - GPTQ - GGUF - AWQ

Model details

Branch	Bits	Perplexity
main	5	6.1018
6bit	6	6.1182
-	7	6.1056
-	8	6.1027

I'll upload the 7 and 8 bits quant if someone request it.

Prompt Format

Alpaca format:

### Instruction:


### Response:

---

license: other