Vision seems to work with mmproj copied from unsloth/Mistral-Small-3.1-24B-Instruct-2503
#1
by
mingyi456
- opened
I downloaded the Q5_K_S quant in LM Studio, and copied the F32 mmproj over from your quant of Mistral Small 3.1, and it seems that vision works. Can you guys test it out further to see if it is worth including mmproj files in this repo?
As a side note, vision with MedGemma 27B also seems to work with a normal Gemma 3 27B mmproj file.
We tested it and it seems to work but not that well. We're going to experiment more