ollama run error

#9
by chenbridge - opened

bridge@BRIDGE-AORUS:$ ollama -v
ollama version is 0.6.5
bridge@BRIDGE-AORUS:
$ ollama run hf.co/google/gemma-3-12b-it-qat-q4_0-gguf
pulling manifest
Error: pull model manifest: Get "https://huggingface.co/api/models/google/gemma-3-12b-it-qat-q4_0-gguf/ssh-auth?nonce=7ESktrZPNthdEMIMT4uLMg&scope=&service=&ts=1745227959": read tcp 172.26.36.6:46298->13.33.174.80:443: read: connection reset by peer
bridge@BRIDGE-AORUS:~$

Google org

Hi @chenbridge ,

try following

  • Copy your Ollama SSH key, you can do so via: cat ~/.ollama/id_ed25519.pub | pbcopy
  • Add the corresponding key to your Hugging Face account by going to your account settings and clicking on Add new SSH key.
  • That’s it! You can now run private GGUFs from the Hugging Face Hub: ollama run hf.co/google/gemma-3-12b-it-qat-q4_0-gguf
    reference : https://github.com/ollama/ollama/issues/8045

Kindly try and let us know if you have any concerns. Thank you.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment