not working
i get an error with backyard ai that apparently the file data is not all there or something. so maybe you need to fix it and re-upload this is for Q6_k thanks
Can you give the full error? is it about the tensors being the unexpected number?
Unexpected error: Model file is malformed. Please redownload the file and try again.
from backyard ai :-)
it COULD be an issue with the app itself and not the model but figured id post it anyways
thanks!
had the same error with another similar model too
Hmm okay I'll redownload Q6_K just to be sure, but it is unusual that it would mess up :) poke me in like an hour if I haven't posted an update
Use this, https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF
No problem in LM Studio 0.2.29
Just redownloaded my Q6 and there are no issues
ok thought i posted but apparently not
so apparently this is an issue with backyard.ai's desktop app as i still get the error. ill just post on their discord then
thanks anyways!