Run on Ollama problem
Thank you for this release :)
Have a problem to run it on ollama, using both suggestions (run with cli login and ssh) get
Error: pull model manifest: 401: {"error":"Invalid username or password."}
Have access granted to model.
Thank you for this release :)
Have a problem to run it on ollama, using both suggestions (run with cli login and ssh) get
Error: pull model manifest: 401: {"error":"Invalid username or password."}Have access granted to model.
https://huggingface.co/docs/hub/en/ollama#run-private-ggufs-from-the-hugging-face-hub
Run Private GGUFs from the Hugging Face Hub
You can run private GGUFs from your personal account or from an associated organisation account in two simple steps:
Copy your Ollama SSH key, you can do so via: cat ~/.ollama/id_ed25519.pub | pbcopy
Add the corresponding key to your Hugging Face account by going to your account settings and clicking on Add new SSH key.
That’s it! You can now run private GGUFs from the Hugging Face Hub: ollama run hf.co/{username}/{repository}.
Thank you! Did this but still failed.
Same here. I followed all the instructions, was granted access to the repo, created an access token for that repo with the appropriate permissions and nothing worked. I'm on windows and am trying to download it via Ollama.
Solved! There are 2 different .pub (on Linux)
https://github.com/ollama/ollama/issues/1207#issuecomment-1819938801
Add ollama id_ed25519.pub to https://huggingface.co/settings/keys