IQ1_S quants not compatible with ktransformers

by Lunzima - opened 5 days ago

5 days ago

When trying to run DeepSeek-TNG-R1T2-Chimera-UD-IQ1_S, following error occurs:
NotImplementedError: ggml_type 18 not implemented

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment