runtime error

Exit code: 1. Reason: rors. model.safetensors: 0%| | 0.00/2.00G [00:00<?, ?B/s] model.safetensors: 15%|█▍ | 294M/2.00G [00:01<00:05, 294MB/s] model.safetensors: 76%|███████▋ | 1.53G/2.00G [00:02<00:00, 846MB/s] model.safetensors: 100%|█████████▉| 2.00G/2.00G [00:02<00:00, 864MB/s] /usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py:734: UserWarning: Can't initialize NVML warnings.warn("Can't initialize NVML") Traceback (most recent call last): File "/home/user/app/app.py", line 6, in <module> gpu_model = Gemma3ForConditionalGeneration.from_pretrained(model_id, device_map="auto").eval() File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 279, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4400, in from_pretrained ) = cls._load_pretrained_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4829, in _load_pretrained_model disk_offload_index, cpu_offload_index = _load_state_dict_into_meta_model( File "/usr/local/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 824, in _load_state_dict_into_meta_model _load_parameter_into_model(model, param_name, param.to(param_device)) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 712, in _load_parameter_into_model module.load_state_dict({param_type: tensor}, strict=False, assign=True) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2581, in load_state_dict raise RuntimeError( RuntimeError: Error(s) in loading state_dict for Gemma3TextScaledWordEmbedding: size mismatch for weight: copying a param with shape torch.Size([262144, 1152]) from checkpoint, the shape in current model is torch.Size([262208, 2304]).

Container logs: