https://huggingface.co/DazzlingXeno/New-Dawn-Midnight-34b

#386
by DazzlingXeno - opened

I stole some ideas and made a model, for fun. It's probably insane and broken to hell but might be worth quanting and testing?

We quantize insane, broken, and for fun models just as well :) For fun, too :) Anwaqy, it's quueed, and the progress is at http://hf.tst.eu/status.html

mradermacher changed discussion status to closed

You are a legend, thank you!

Unfortunately, it's really broken. As in, wrong tensor shape after conversion:

llama_model_load: error loading model: check_tensor_dims: tensor 'token_embd.weight' has wrong shape; expected 8192, 128256, got 8192, 32000, 1, 1

Maybe it's a tokenizer issue of some kind.

Awww damn. Cheers for trying mate

no problem, will happily try again if you can fix the issue. or a new model. keep them coming :)

Sign up or log in to comment