how can i convert weights to safetensors?

#212
by doas - opened

Sorry for a very trivial question.
how can i convert weights to safetensors and upload the huggingface repo and submit?

Open LLM Leaderboard org

Hi,
The documentation is here, and you can also use this space to do it automatically.

@doas is it working for you? the auto conveter thing?

@clefourrier I know that document but it is not enough for me...
@ashercn97 not working. It keeps saying processing.

@porkorbeef The documentation is kinda useless and the thing kept giving me some error about tensors being blank..

Open LLM Leaderboard org
edited Aug 23, 2023

Hi!
The space can be a bit slow for bigger models. You could also try using the code locally on your machine, conversion functions are in this file.
Good luck with this :)

Please ping me if there's issues on specific models or timeframes on the convertion space.

It's VERY active as it's chunking a lot of models automatically, therefore it might be a bit full for other users.

We're trying to improve the situation seemlessly, but we might be missing some issues with some specific models

Okay! @Narsil I have an issue on the thing lemme tag you in it!!

Open LLM Leaderboard org

The documentation has been updated here, I'll close this issue for the moment as it's not leaderboard linked

clefourrier changed discussion status to closed

Sign up or log in to comment