basurasolamente

/

GPT4-X-Alpaca-30B-4bit

like 0

I pulled it form Hugging Face using the built-in Model Downloader, but when I try to load the model it generates errors in the console.

It seems that the index file for the model references split bin files that are non-existent in the Repo:

Loading checkpoint shards:   0%|                                                                      | 0/61 [00:00<?, ?it/s]
2023-11-14 10:24:53 ERROR:Failed to load the model.
Traceback (most recent call last):
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/modeling_utils.py", line 484, in load_state_dict
    return torch.load(checkpoint_file, map_location=map_location)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/serialization.py", line 986, in load
    with _open_file_like(f, 'rb') as opened_file:
         ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/serialization.py", line 435, in _open_file_like
    return _open_file(name_or_buffer, mode)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/serialization.py", line 416, in __init__
    super().__init__(open(name, mode))
                     ^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'models/basurasolamente_GPT4-X-Alpaca-30B-4bit/pytorch_model-00001-of-00061.bin'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/modules/ui_model_menu.py", line 210, in load_model_wrapper
    shared.model, shared.tokenizer = load_model(shared.model_name, loader)
                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/modules/models.py", line 85, in load_model
    output = load_func_map[loader](model_name)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/modules/models.py", line 148, in huggingface_loader
    model = LoaderClass.from_pretrained(path_to_model, **params)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 566, in from_pretrained
    return model_class.from_pretrained(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3480, in from_pretrained
    ) = cls._load_pretrained_model(
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3856, in _load_pretrained_model
    state_dict = load_state_dict(shard_file)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/tokenwizard/AI-Stuff/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/modeling_utils.py", line 487, in load_state_dict
    with open(checkpoint_file) as f:
         ^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'models/basurasolamente_GPT4-X-Alpaca-30B-4bit/pytorch_model-00001-of-00061.bin'```