bartowski
/

Mistral-7B-codealpaca-lora-exl2

Model card Files Files and versions

bartowski commited on Oct 29, 2023

Commit

346c551

·

1 Parent(s): d9dfa5c

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -7,6 +7,8 @@ tags:
 ## Exllama v2 Quantization of Mistral-7B-codealpaca-lora
 Conversion done using evol-codealpaca-v1.parquet as calibration dataset.
 Original model: https://huggingface.co/Nondzu/Mistral-7B-codealpaca-lora

 ## Exllama v2 Quantization of Mistral-7B-codealpaca-lora
+Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.6">turboderp's ExLlamaV2 v0.0.6</a> for quantization.
 Conversion done using evol-codealpaca-v1.parquet as calibration dataset.
 Original model: https://huggingface.co/Nondzu/Mistral-7B-codealpaca-lora