could not run in LM studio error
#1
by
aleksey-6
- opened
🥲 Не удалось загрузить модель
Failed to load model
error loading model: missing tensor 'blk.9.ffn_norm.weight'
that's... very curious..
It's possible we need a version update to get it to work
lm studio - 0.3.16(buuild 1) + CUDA llama.cpp (Windows) v 1.29.0+ nvidia_Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L , does not work, if someone works, write what configuration.
lm studio - 0.3.16(buuild 1) + CUDA llama.cpp (Windows) v 1.30.0+ nvidia_Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L -----
started Thank you
beautiful thanks for confirming!
llama_decode: failed to decode, ret = -3
Metal llama.cpp
v1.30.0
- Llama-3_1-Nemotron-Ultra-253B support
- nomic-embed-code support
- llama.cpp updated to b5283 (commit 5215b91)