ollama? please?

#17
by AlgorithmicKing - opened

can you please upload them to ollama? because as you know, ollama currently cant pull multiple gguf files.
also, really apreciat the work you are doing for the community.πŸ’πŸ’πŸ’β€οΈβ€οΈβ€οΈ

the iq4 one in specific

Unsloth AI org

can you please upload them to ollama? because as you know, ollama currently cant pull multiple gguf files.
also, really apreciat the work you are doing for the community.πŸ’πŸ’πŸ’β€οΈβ€οΈβ€οΈ

Hi there we were thinking of uploading them. We'll try to when we get the chance

can you please upload them to ollama? because as you know, ollama currently cant pull multiple gguf files.
also, really apreciat the work you are doing for the community.πŸ’πŸ’πŸ’β€οΈβ€οΈβ€οΈ

You can first download multiple GGUF files locally, then use llama-gguf-split to merge them into a single GGUF file, and finally use ollama create to import the model.

Sign up or log in to comment