Hugging Face's logo

Peeepy
/
llama-30b-oasst-4bit-128g

Text Generation
Transformers
llama
Inference Endpoints
Model card Files Community
1
Peeepy commited on
Commit
6436cd7
·
1 Parent(s): f8b5fa3

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md ADDED
@@ -0,0 +1 @@
 
 
1
+ huggyllama/llama-30b merged with serpdotai/llama-oasst-lora-30B, quantized to 4bit with 128g groupsize. 16bit and non-groupsize versions are on my repo as well.