Hugging Face's logo

waldie
/
Dans-AdventurousWinds-Mk2-7b-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
English
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

quant of PocketDoc's Dans-AdventurousWinds-Mk2-7b

python3 convert.py \
    -i /input/PocketDoc_Dans-AdventurousWinds-Mk2-7b/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/8.0bpw/ \
    -b 8.0 \
    -hb 8
Downloads last month
13
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Datasets used to train waldie/Dans-AdventurousWinds-Mk2-7b-8bpw-h8-exl2