MISHANM

/

google-gemma-3-27b-it-fp8

like 3

On vllm 0.8.1 I receive such an error:

ERROR 03-23 21:40:02 [engine.py:448] File "/opt/venv/lib/python3.12/site-packages/vllm/model_executor/models/gemma3.py", line 449, in load_weights
ERROR 03-23 21:40:02 [engine.py:448] param = params_dict[name]
ERROR 03-23 21:40:02 [engine.py:448] ~~~~~~~~~~~^^^^^^
ERROR 03-23 21:40:02 [engine.py:448] KeyError: 'layers.52.mlp.down_proj.SCB'