Hugging Face's logo

HuggingFaceH4
/
starchat-beta

Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
gpt_bigcode
Generated from Trainer
text-generation-inference
Model card Files
xet
Metrics Community
31

GGML demo

#6
by matthoffner - opened
Discussion
matthoffner

I've put together a demo using a quantized ggml version from @TheBloke running on a CPU upgrade space:

API: https://huggingface.co/spaces/matthoffner/starchat-ggml
UI: https://huggingface.co/spaces/matthoffner/starchat-ui

lewtun
 Hugging Face H4 org

Awesome work @matthoffner !!

TheBloke
•
edited Jun 15, 2023

Very nice!I have linked them in the README of my GGML repo

image.png

matthoffner

Thanks @TheBloke @lewtun !

matthoffner changed discussion status to closed
navyfighter12

i am getting errors when trying to build https://huggingface.co/spaces/matthoffner/starchat-ggml

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment