runtime error

Exit code: 1. Reason: 03.safetensors: 44%|████▍ | 2.02G/4.58G [00:05<00:05, 494MB/s] model-00002-of-00003.safetensors: 55%|█████▌ | 2.53G/4.58G [00:06<00:04, 426MB/s] model-00002-of-00003.safetensors: 72%|███████▏ | 3.28G/4.58G [00:07<00:02, 509MB/s] model-00002-of-00003.safetensors: 83%|████████▎ | 3.82G/4.58G [00:09<00:01, 499MB/s] model-00002-of-00003.safetensors: 100%|█████████▉| 4.58G/4.58G [00:09<00:00, 464MB/s] model-00003-of-00003.safetensors: 0%| | 0.00/835M [00:00<?, ?B/s] model-00003-of-00003.safetensors: 3%|▎ | 21.0M/835M [00:01<00:41, 19.6MB/s] model-00003-of-00003.safetensors: 46%|████▌ | 384M/835M [00:02<00:02, 205MB/s]  model-00003-of-00003.safetensors: 100%|█████████▉| 835M/835M [00:02<00:00, 302MB/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 3/3 [00:00<00:00, 1482.78it/s] generation_config.json: 0%| | 0.00/168 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 168/168 [00:00<00:00, 1.33MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 46, in <module> llm_model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 571, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 309, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4668, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 504, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs:

Fetching error logs...