Devstral with experimental VISION support
Hey guys, we latched on Mistral Small 3.1's mmproj file, all thanks to @ngxson , and Nguyen says it works pretty well! :)
Let us know if there are any issues or problems with this addition of vision support.
And the vision support is totally optional. Would recommend reading about the vision support here: https://docs.unsloth.ai/basics/devstral-how-to-run-and-fine-tune#possible-vision-support
This is an awesome idea!
Thanks for having given it a try, guys!
And really thanks to MistralAI too! You are the heroes of the people!
thanks everyone for living in this beautiful world
Can you please publish a version of this model that doesn't require grafting it on the CLI? (ie add the ViT and mmproj to the model and save it that way)
@erichartford Apologies on the late reply - unfortunately for GGUFs, they must for now have 2 files - I think llama.cpp is working on merging them!