UD-Q5_K_XL ?

by AaronFeng753 - opened 2 days ago

2 days ago

since Q5KM is 21.7 GB, a UD-Q5_K_XL gguf should be around 20GB~ and can be fully loaded into a 24gb card

Thank you for these UD ggufs!

Unsloth AI org 1 day ago

Thanks for the suggestion we'll see what we can do :)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment