Hugging Face's logo
Matthew Douglas's picture
TFLOPS icon 189.2 TFLOPS
6 33 181

Matthew Douglas

mdouglas
LTRShadowblade's profile picture stereoplegic's profile picture aboundy's profile picture
·

AI & ML interests

LLMs, quantization, NLP, embeddings, hardware, DevEx

Articles

Organizations

Hugging Face's profile picture Hugging Face Discord Community's profile picture LLHF's profile picture llmc's profile picture SLLHF's profile picture Hugging Quants's profile picture blhf's profile picture

mdouglas's activity

New activity in hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 3 days ago

update the config.json and the weights

1
#1 opened about 1 month ago by Rudra-ai
New activity in google/gemma-2-27b-it about 2 months ago

4 bit and 8 bit bnb quants only generate empty strings or one token repeated endlessly

1
#32 opened about 2 months ago by nicorinn-google

4bit-quantized gemma-2-27b-it generates only pad tokens, like '<pad><pad><pad><pad><pad><pad><pad><pad><pad>'.

3
#29 opened 2 months ago by kshinoda

Update bitsandbytes examples

1
#33 opened about 2 months ago by mdouglas
New activity in hugging-quants/Meta-Llama-3.1-8B-BNB-NF4 about 2 months ago

Update `license`
#1 opened about 2 months ago by alvarobartt
New activity in mdouglas/guanamyra-small 10 months ago

Adding `safetensors` variant of this model
#1 opened 10 months ago by SFconvertbot