Error when trying to run manually downloaded model weights
#27
by
aldrichshawn
- opened
I’m trying to run the Nomic embedding model locally without requiring an internet connection or downloading code at runtime. I’ve downloaded the model weights and tokenizer and Python files (modeling_hf_nomic_bert.py, configuration_hf_nomic_bert.py).
placed all required files in one local folder as follows.
my_nomic_model/
├── configuration_hf_nomic_bert.py
├── modeling_hf_nomic_bert.py
├── model weights and files
Even with trust_remote_code=True and local_files_only=True, the model still tries to connect to Hugging Face to fetch the custom code files. I want to fully isolate the model so that all required code and data are in one place.
Any example or documentation on how to cleanly run this model fully offline would be greatly appreciated!