Getting error on inference api
#8
by
pulkitmehtawork
- opened
The checkpoint you are trying to load has model type modernbert but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
pulkitmehtawork
changed discussion title from
Getting error on inference end pt
to Getting error on inference api
Hello!
The modernbert architecture is extremely new, so much so that it hasn't yet been included in a transformers. Because of that, you'll have to install the unreleased version directly from GitHub:
pip install git+https://github.com/huggingface/transformers.git
Then your script should work correctly.
- Tom Aarsen
Thanks Tom
pulkitmehtawork
changed discussion status to
closed