malformed error with Q6_K
#1
by
Evenios
- opened
i get this error in backyard ai
Unexpected error: Model file is malformed. Please redownload the file and try again.
so might be an uploading issue or something?
thanks
I recommend using the latest version of KoboldCpp for the model inference as it's the project that most quickly gets the latest features and compatibility from upstream llama.cpp.
The uploaded model is working as expected on my end in the latest release. It might be worth looking if that wasn't an issue at the time with the Backyard AI software and Llama 3.1 compatibility.