Does not work
#1
by
zokica
- opened
pydantic_core._pydantic_core.ValidationError: 1 validation error for QuantizationArgs
Value error, strategy group requires group_size to be set to a positive value [type=value_error, input_value={'strategy': <Quantizatio...roup'>, 'group_size': 0}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.10/v/value_error
I ran exactly the same code as you wrote
@zokica
that's weird, given that group_size is 128 in the config.
It could be the issue with misspecification with lm_head.
Could you please try now?