libc++abi out_of_range key not found
#1
by
telehan
- opened
test run with llama.cpp main, got error on GGUF Q8
main: build = 2442 (d84c4850)
main: built with Apple clang version 15.0.0 (clang-1500.3.9.4) for arm64-apple-darwin23.4.0
main: seed = 171092134
...
llm_load_vocab: SPM vocabulary, but newline token not found: unordered_map::at: key not found! Using special_pad_id instead.llm_load_vocab: mismatch in special tokens definition ( 2387/102400 vs 2400/102400 ).
llm_load_print_meta: format = GGUF V3 (latest)
...
llm_load_print_meta: model ftype = Q8_0
llm_load_print_meta: model params = 6.91 B
llm_load_print_meta: model size = 6.84 GiB (8.50 BPW)
...
system_info: n_threads = 12 / 16 | AVX = 0 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 1 | ARM_FMA = 1 | F16C = 0 | FP16_VA = 1 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 0 | SSSE3 = 0 | VSX = 0 | MATMUL_INT8 = 0 |
libc++abi: terminating due to uncaught exception of type std::out_of_range: unordered_map::at: key not found