LLaMA3-LLaVA-NeXT-8B GGUF files
GGUF version of https://huggingface.co/lmms-lab/llama3-llava-next-8b
download the mmproj-model-f16.gguf and any quant you want of llama3-llava-next-8b-*.gguf
Follow the readme from llama.cpp
or the readme from llama-cpp-python
- Downloads last month
- 323
Hardware compatibility
Log In
to view the estimation
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.