LoneStriker
/

Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2

Commit History

Added note on repetition penalty setting

b17120c

LoneStriker commited on Nov 11, 2023

Update README.md

2947882

LoneStriker commited on Nov 11, 2023

ExLLaMA V2 quant of Yi-34B-Spicyboros-3.1-4.65bpw-h6-exl2

2bbf983

LoneStriker commited on Nov 11, 2023

initial commit

d24ea6e

LoneStriker commited on Nov 11, 2023