ImportError

#5
by AhmadDadash - opened

when i use this versions : transformers==4.46.3 autoawq==0.2.5 peft==0.14.0 (in the kaggle)

i run the sample code and this error happen: ImportError: cannot import name 'Mistral3ForConditionalGeneration' from 'transformers' (/usr/local/lib/python3.11/dist-packages/transformers/init.py)

can anyone help me please?

Open Platform for Enterprise AI org

the readme shows that the version of transformers should be >4.52

i change the version of transformers version to "4.52.4"and (autoawq==0.2.5 peft==0.14.0)
Now the error is: ImportError: cannot import name 'shard_checkpoint' from 'transformers.modeling_utils' (/usr/local/lib/python3.11/dist-packages/transformers/modeling_utils.py)

Open Platform for Enterprise AI org

The issue doesn't stem from the model itself. If you've searched online, it's likely related to your AutoAWQ or Pref version

what you recommend for me to use which version of transformers and autoawq for this code? i really need help with this problem

Open Platform for Enterprise AI org
edited Jul 10

Since we didn't record the specific versions of each library, we don't have that information available. Let's try upgrading both to the latest versions first. If that doesn't work, we can try downgrading some of them to see if it resolves the issue.
Besides, to my knowledge, peft is not required, you could uninstall it for now if I am right

Sign up or log in to comment