Good-quality quants

by FalconNet - opened 3 days ago

3 days ago

@shimmyshimmer @danielhanchen
Dear Unsloth, could you please make quants for this model? Q8_0 for it would be helpful for me as well as bnb 4bit.
Thanks a lot!

shimmyshimmer

2 days ago

@shimmyshimmer @danielhanchen
Dear Unsloth, could you please make quants for this model? Q8_0 for it would be helpful for me as well as bnb 4bit.
Thanks a lot!

Looks interesting we'll take a look and see what we can do

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment