mat1 and mat2 shapes cannot be multiplied

#1
by Djrema - opened

Just replaced the working FP8 version for the gguf and had this error:

mat1 and mat2 shapes cannot be multiplied (5456x1280 and 3840x1280)

It works normally with the FP8 version.
I'm on comfy 0.3.52

Anything I could try for fixing it?

Thanks

which fp8 and which gguf? and does comfy even support qwen 2.5 vl? can you try with llama.cpp, for which these files were made?

@Djrema
https://huggingface.co/prithivMLmods/Qwen2.5-VL-7B-Abliterated-Caption-it/discussions/2

I think you are facing the same issue. πŸ‘†
Kindly check out the discussion.

Thanks mate. I'll check that out.

Sign up or log in to comment