本地模型加载太慢

#46

by pxkkkkk - opened Mar 21, 2024

Mar 21, 2024

请问量化后加载过程还是很慢是怎么回事？？？Loading checkpoint shards: 100%|██████████| 7/7 [08:51<00:00, 75.92s/it]

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org Mar 24, 2024

这个模型没有做量化上的优化，你如果在CPU加载肯定很慢

pxkkkkk changed discussion status to closed Mar 25, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment