Cannot load model after downloading all safetensors

#1
by glli - opened

It seems that you forgot adding metadata to the safetensors, and it is impossible to load them with transformers. Could you check it?

FriendliAI org
edited Apr 24

@glli
Thank you for downloading our checkpoint.
This model checkpoint is not executable with transformers library. You can run this model using Friendli Container with a proper GPU (e.g., NVIDIA H100 or L4 GPU).
For details, please refer to our model card.

Thanks for your information. Could you please add this notification to the model card? I have spent hours downloading the checkpoints. And found it cannot run with transformers, very disappointing.

glli changed discussion status to closed

Sign up or log in to comment